Nov 28 22:54:30 user nova-compute[74959]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74959) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74959) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74959) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 22:54:30 user nova-compute[74959]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:54:30 user nova-compute[74959]: INFO nova.virt.driver [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 22:54:30 user nova-compute[74959]: INFO nova.compute.provider_config [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] Acquiring lock "singleton_lock" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] Acquired lock "singleton_lock" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] Releasing lock "singleton_lock" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] Full set of CONF: {{(pid=74959) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ******************************************************************************** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] Configuration options gathered from: {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ================================================================================ {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] allow_resize_to_same_host      = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] arq_binding_timeout            = 300 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] backdoor_port                  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] backdoor_socket                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] block_device_allocate_retries  = 300 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] block_device_allocate_retries_interval = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cert                           = self.pem {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute_monitors               = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] config_dir                     = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] config_drive_format            = iso9660 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] config_source                  = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] console_host                   = user {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] control_exchange               = nova {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cpu_allocation_ratio           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] daemon                         = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] debug                          = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] default_access_ip_network_name = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] default_availability_zone      = nova {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] default_ephemeral_format       = ext4 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] default_green_pool_size        = 1000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] default_schedule_zone          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] disk_allocation_ratio          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] enable_new_services            = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] enabled_ssl_apis               = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] flat_injected                  = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] force_config_drive             = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] force_raw_images               = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] graceful_shutdown_timeout      = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] heal_instance_info_cache_interval = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] host                           = user {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] instance_build_timeout         = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] instance_delete_interval       = 300 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] instance_name_template         = instance-%08x {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] instance_usage_audit           = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] instance_usage_audit_period    = month {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] internal_service_availability_zone = internal {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] key                            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] live_migration_retry_count     = 30 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] log_config_append              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] log_dir                        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] log_file                       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] log_options                    = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] log_rotate_interval            = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] log_rotate_interval_type       = days {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] log_rotation_type              = none {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] long_rpc_timeout               = 1800 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] max_concurrent_builds          = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] max_concurrent_live_migrations = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] max_concurrent_snapshots       = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] max_local_block_devices        = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] max_logfile_count              = 30 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] max_logfile_size_mb            = 200 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] maximum_instance_delete_attempts = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] metadata_listen                = 0.0.0.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] metadata_listen_port           = 8775 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] metadata_workers               = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] migrate_max_retries            = -1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] mkisofs_cmd                    = genisoimage {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] my_ip                          = 10.0.0.210 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] network_allocate_retries       = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] osapi_compute_listen_port      = 8774 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] osapi_compute_unique_server_name_scope =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] osapi_compute_workers          = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] password_length                = 12 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] periodic_enable                = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] periodic_fuzzy_delay           = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] pointer_model                  = ps2mouse {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] preallocate_images             = none {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] publish_errors                 = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] pybasedir                      = /opt/stack/nova {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ram_allocation_ratio           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] rate_limit_burst               = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] rate_limit_except_level        = CRITICAL {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] rate_limit_interval            = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] reboot_timeout                 = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] reclaim_instance_interval      = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] record                         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] reimage_timeout_per_gb         = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] report_interval                = 120 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] rescue_timeout                 = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] reserved_host_cpus             = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] reserved_host_disk_mb          = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] reserved_host_memory_mb        = 512 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] reserved_huge_pages            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] resize_confirm_window          = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] resize_fs_using_block_device   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] resume_guests_state_on_host_boot = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] rpc_response_timeout           = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] run_external_periodic_tasks    = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] running_deleted_instance_action = reap {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] running_deleted_instance_timeout = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler_instance_sync_interval = 120 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_down_time              = 720 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] servicegroup_driver            = db {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] shelved_offload_time           = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] shelved_poll_interval          = 3600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] shutdown_timeout               = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] source_is_ipv6                 = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ssl_only                       = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] state_path                     = /opt/stack/data/nova {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] sync_power_state_interval      = 600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] sync_power_state_pool_size     = 1000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] syslog_log_facility            = LOG_USER {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] tempdir                        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] timeout_nbd                    = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] transport_url                  = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] update_resources_interval      = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] use_cow_images                 = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] use_eventlog                   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] use_journal                    = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] use_json                       = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] use_rootwrap_daemon            = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] use_stderr                     = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] use_syslog                     = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vcpu_pin_set                   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plugging_is_fatal          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plugging_timeout           = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] virt_mkfs                      = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] volume_usage_poll_interval     = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] watch_log_file                 = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] web                            = /usr/share/spice-html5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_concurrency.disable_process_locking = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.auth_strategy              = keystone {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.compute_link_prefix        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.dhcp_domain                = novalocal {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.enable_instance_password   = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.glance_link_prefix         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.instance_list_per_project_cells = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.list_records_by_skipping_down_cells = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.local_metadata_per_cell    = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.max_limit                  = 1000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.metadata_cache_expiration  = 15 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.neutron_default_tenant_id  = default {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.use_forwarded_for          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.use_neutron_default_nets   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.vendordata_dynamic_targets = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.vendordata_jsonfile_path   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.backend_argument         = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.config_prefix            = cache.oslo {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.dead_timeout             = 60.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.debug_cache_backend      = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.enable_retry_client      = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.enable_socket_keepalive  = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.enabled                  = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.expiration_time          = 600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.hashclient_retry_attempts = 2 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_dead_retry      = 300 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_password        =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_sasl_enabled    = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.memcache_username        =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.proxies                  = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.retry_attempts           = 2 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.retry_delay              = 0.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.socket_keepalive_count   = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.socket_keepalive_idle    = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.socket_keepalive_interval = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.tls_allowed_ciphers      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.tls_cafile               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.tls_certfile             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.tls_enabled              = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cache.tls_keyfile              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.auth_section            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.auth_type               = password {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.cafile                  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.certfile                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.collect_timing          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.cross_az_attach         = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.debug                   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.endpoint_template       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.http_retries            = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.insecure                = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.keyfile                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.os_region_name          = RegionOne {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.split_loggers           = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cinder.timeout                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.cpu_dedicated_set      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.cpu_shared_set         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.image_type_exclude_list = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.resource_provider_association_refresh = 300 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.shutdown_retry_interval = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] conductor.workers              = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] console.allowed_origins        = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] console.ssl_ciphers            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] console.ssl_minimum_version    = default {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] consoleauth.token_ttl          = 600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.cafile                  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.certfile                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.collect_timing          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.connect_retries         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.connect_retry_delay     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.endpoint_override       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.insecure                = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.keyfile                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.max_version             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.min_version             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.region_name             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.service_name            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.service_type            = accelerator {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.split_loggers           = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.status_code_retries     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.status_code_retry_delay = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.timeout                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] cyborg.version                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.backend               = sqlalchemy {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.connection            = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.connection_debug      = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.connection_parameters =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.connection_recycle_time = 3600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.connection_trace      = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.db_inc_retry_interval = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.db_max_retries        = 20 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.db_max_retry_interval = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.db_retry_interval     = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.max_overflow          = 50 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.max_pool_size         = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.max_retries           = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.mysql_wsrep_sync_wait = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.pool_timeout          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.retry_interval        = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.slave_connection      = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] database.sqlite_synchronous    = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.backend           = sqlalchemy {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.connection        = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.connection_debug  = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.connection_parameters =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.connection_recycle_time = 3600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.connection_trace  = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.db_inc_retry_interval = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.db_max_retries    = 20 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.db_max_retry_interval = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.db_retry_interval = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.max_overflow      = 50 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.max_pool_size     = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.max_retries       = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.pool_timeout      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.retry_interval    = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.slave_connection  = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] api_database.sqlite_synchronous = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] devices.enabled_mdev_types     = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ephemeral_storage_encryption.enabled = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.api_servers             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.cafile                  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.certfile                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.collect_timing          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.connect_retries         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.connect_retry_delay     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.debug                   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.default_trusted_certificate_ids = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.enable_certificate_validation = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.enable_rbd_download     = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.endpoint_override       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.insecure                = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.keyfile                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.max_version             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.min_version             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.num_retries             = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.rbd_ceph_conf           =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.rbd_connect_timeout     = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.rbd_pool                =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.rbd_user                =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.region_name             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.service_name            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.service_type            = image {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.split_loggers           = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.status_code_retries     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.status_code_retry_delay = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.timeout                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.verify_glance_signatures = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] glance.version                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] guestfs.debug                  = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.config_drive_cdrom      = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.config_drive_inject_password = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.enable_remotefx         = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.instances_path_share    =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.limit_cpu_features      = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.use_multipath_io        = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.vswitch_name            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] mks.enabled                    = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] image_cache.manager_interval   = 2400 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] image_cache.precache_concurrency = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] image_cache.remove_unused_base_images = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] image_cache.subdirectory_name  = _base {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.api_max_retries         = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.api_retry_interval      = 2 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.auth_section            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.auth_type               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.cafile                  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.certfile                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.collect_timing          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.conductor_group         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.connect_retries         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.connect_retry_delay     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.endpoint_override       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.insecure                = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.keyfile                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.max_version             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.min_version             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.peer_list               = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.region_name             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.serial_console_state_timeout = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.service_name            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.service_type            = baremetal {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.split_loggers           = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.status_code_retries     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.status_code_retry_delay = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.timeout                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ironic.version                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] key_manager.fixed_key          = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.barbican_api_version  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.barbican_endpoint     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.barbican_endpoint_type = public {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.barbican_region_name  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.cafile                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.certfile              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.collect_timing        = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.insecure              = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.keyfile               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.number_of_retries     = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.retry_delay           = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.send_service_user_token = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.split_loggers         = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.timeout               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.verify_ssl            = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican.verify_ssl_path       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.auth_section = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.auth_type = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.cafile   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.certfile = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.collect_timing = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.insecure = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.keyfile  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.split_loggers = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] barbican_service_user.timeout  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.approle_role_id          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.approle_secret_id        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.cafile                   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.certfile                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.collect_timing           = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.insecure                 = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.keyfile                  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.kv_mountpoint            = secret {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.kv_path                  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.kv_version               = 2 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.namespace                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.root_token_id            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.split_loggers            = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.ssl_ca_crt_file          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.timeout                  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.use_ssl                  = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.auth_section          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.auth_type             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.cafile                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.certfile              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.collect_timing        = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.connect_retries       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.connect_retry_delay   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.endpoint_override     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.insecure              = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.keyfile               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.max_version           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.min_version           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.region_name           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.service_name          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.service_type          = identity {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.split_loggers         = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.status_code_retries   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.status_code_retry_delay = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.timeout               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] keystone.version               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.connection_uri         =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.cpu_mode               = custom {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: WARNING oslo_config.cfg [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.cpu_power_governor_high = performance {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.cpu_power_management   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.device_detach_attempts = 8 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.device_detach_timeout  = 20 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.disk_cachemodes        = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.disk_prefix            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.enabled_perf_events    = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.file_backed_memory     = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.gid_maps               = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.hw_disk_discard        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.hw_machine_type        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.images_rbd_pool        = rbd {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.images_type            = default {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.images_volume_group    = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.inject_key             = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.inject_partition       = -2 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.inject_password        = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.iscsi_iface            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.iser_use_multipath     = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_downtime = 500 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_inbound_addr = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_scheme  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_timeout_action = abort {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_tunnelled = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: WARNING oslo_config.cfg [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 22:54:30 user nova-compute[74959]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 22:54:30 user nova-compute[74959]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 22:54:30 user nova-compute[74959]: and ``live_migration_inbound_addr`` respectively.
Nov 28 22:54:30 user nova-compute[74959]: ).  Its value may be silently ignored in the future.
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.live_migration_with_native_tls = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.max_queues             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.nfs_mount_options      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.num_pcie_ports         = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.pmem_namespaces        = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.quobyte_client_cfg     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rbd_secret_uuid        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rbd_user               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rescue_image_id        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rescue_kernel_id       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.rx_queue_size          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.smbfs_mount_options    =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.snapshot_compression   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.snapshot_image_format  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.sparse_logical_volumes = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.swtpm_enabled          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.swtpm_group            = tss {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.swtpm_user             = tss {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.sysinfo_serial         = unique {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.tb_cache_size          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.tx_queue_size          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.uid_maps               = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.use_virtio_for_bridges = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.virt_type              = kvm {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.volume_clear           = zero {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.volume_clear_size      = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.volume_use_multipath   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.vzstorage_cache_path   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.auth_section           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.auth_type              = password {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.cafile                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.certfile               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.collect_timing         = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.connect_retries        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.connect_retry_delay    = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.default_floating_pool  = public {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.endpoint_override      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.extension_sync_interval = 600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.http_retries           = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.insecure               = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.keyfile                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.max_version            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.min_version            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.ovs_bridge             = br-int {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.physnets               = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.region_name            = RegionOne {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.service_metadata_proxy = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.service_name           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.service_type           = network {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.split_loggers          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.status_code_retries    = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.status_code_retry_delay = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.timeout                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] neutron.version                = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] notifications.bdms_in_notifications = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] notifications.default_level    = INFO {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] notifications.notification_format = unversioned {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] notifications.notify_on_state_change = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] pci.alias                      = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] pci.device_spec                = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] pci.report_in_placement        = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.auth_section         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.auth_type            = password {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.cafile               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.certfile             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.collect_timing       = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:30 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.connect_retries      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.connect_retry_delay  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.default_domain_id    = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.default_domain_name  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.domain_id            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.domain_name          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.endpoint_override    = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.insecure             = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.keyfile              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.max_version          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.min_version          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.password             = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.project_domain_id    = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.project_domain_name  = Default {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.project_id           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.project_name         = service {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.region_name          = RegionOne {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.service_name         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.service_type         = placement {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.split_loggers        = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.status_code_retries  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.status_code_retry_delay = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.system_scope         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.timeout              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.trust_id             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.user_domain_id       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.user_domain_name     = Default {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.user_id              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.username             = placement {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] placement.version              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.cores                    = 20 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.count_usage_from_placement = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.injected_file_content_bytes = 10240 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.injected_file_path_length = 255 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.injected_files           = 5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.instances                = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.key_pairs                = 100 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.metadata_items           = 128 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.ram                      = 51200 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.recheck_quota            = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.server_group_members     = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] quota.server_groups            = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] rdp.enabled                    = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.image_metadata_prefilter = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.max_attempts         = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.max_placement_results = 1000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] scheduler.workers              = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.host_subset_size = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.isolated_hosts = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.isolated_images = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.pci_in_placement = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.track_instance_changes = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] metrics.required               = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] metrics.weight_multiplier      = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] metrics.weight_setting         = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] serial_console.enabled         = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] serial_console.port_range      = 10000:20000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] serial_console.serialproxy_port = 6083 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.auth_section      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.auth_type         = password {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.cafile            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.certfile          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.collect_timing    = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.insecure          = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.keyfile           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.send_service_user_token = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.split_loggers     = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] service_user.timeout           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.agent_enabled            = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.enabled                  = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.html5proxy_port          = 6082 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.image_compression        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.jpeg_compression         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.playback_compression     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.server_listen            = 127.0.0.1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.streaming_mode           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] spice.zlib_compression         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] upgrade_levels.baseapi         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] upgrade_levels.compute         = auto {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] upgrade_levels.conductor       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] upgrade_levels.scheduler       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.cafile = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.certfile = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.insecure = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vendordata_dynamic_auth.timeout = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.api_retry_count         = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.ca_file                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.cache_prefix            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.cluster_name            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.connection_pool_size    = 10 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.console_delay_seconds   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.datastore_regex         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.host_ip                 = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.host_password           = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.host_port               = 443 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.host_username           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.insecure                = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.integration_bridge      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.maximum_objects         = 100 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.pbm_default_policy      = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.pbm_enabled             = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.pbm_wsdl_location       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.serial_port_proxy_uri   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.serial_port_service_uri = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.task_poll_interval      = 0.5 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.use_linked_clone        = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.vnc_keymap              = en-us {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.vnc_port                = 5900 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vmware.vnc_port_total          = 10000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.auth_schemes               = ['none'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.enabled                    = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.novncproxy_port            = 6080 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.vencrypt_ca_certs          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.vencrypt_client_cert       = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vnc.vencrypt_client_key        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.disable_rootwrap   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.enable_numa_live_migration = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.libvirt_disable_apic = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.client_socket_timeout     = 900 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.default_pool_size         = 1000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.keep_alive                = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.max_header_line           = 16384 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.ssl_ca_file               = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.ssl_cert_file             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.ssl_key_file              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.tcp_keepidle              = 600 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] zvm.ca_file                    = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] zvm.cloud_connector_url        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] zvm.reachable_timeout          = 300 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.enforce_new_defaults = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.enforce_scope      = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.policy_default_rule = default {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.connection_string     = messaging:// {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.enabled               = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.es_doc_type           = notification {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.es_scroll_size        = 10000 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.es_scroll_time        = 2m {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.filter_error_trace    = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.hmac_keys             = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.sentinel_service_name = mymaster {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.socket_timeout        = 0.1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.trace_requests        = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler.trace_sqlalchemy      = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler_jaeger.process_tags   = {} {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler_jaeger.service_name_prefix = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] profiler_otlp.service_name_prefix = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] remote_debug.host              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] remote_debug.port              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_notifications.retry = -1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.auth_section        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.auth_type           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.cafile              = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.certfile            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.collect_timing      = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.connect_retries     = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.connect_retry_delay = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.endpoint_id         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.endpoint_override   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.insecure            = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.keyfile             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.max_version         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.min_version         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.region_name         = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.service_name        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.service_type        = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.split_loggers       = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.status_code_retries = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.status_code_retry_delay = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.timeout             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.valid_interfaces    = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_limit.version             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_reports.file_event_handler = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] oslo_reports.log_dir           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_ovs_privileged.group  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] vif_plug_ovs_privileged.user   = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_ovs.isolate_vif         = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] os_brick.lock_path             = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] privsep_osbrick.capabilities   = [21] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] privsep_osbrick.group          = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] privsep_osbrick.helper_command = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] privsep_osbrick.user           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] nova_sys_admin.group           = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] nova_sys_admin.helper_command  = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] nova_sys_admin.user            = None {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG oslo_service.service [None req-f7cca75c-e76d-4acd-a09c-b16e6ba6aeb9 None None] ******************************************************************************** {{(pid=74959) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 22:54:31 user nova-compute[74959]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 22:54:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Connecting to libvirt: qemu:///system {{(pid=74959) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f5ef490a410> {{(pid=74959) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 22:54:31 user nova-compute[74959]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 22:54:31 user nova-compute[74959]: WARNING nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 22:54:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f5ef490a410> {{(pid=74959) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Starting native event thread {{(pid=74959) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Starting green dispatch thread {{(pid=74959) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 22:54:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Starting connection event dispatch thread {{(pid=74959) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 22:54:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Connection event '1' reason 'None'
Nov 28 22:54:31 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 22:54:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.mount [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Initialising _HostMountState generation 0 {{(pid=74959) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 22:54:38 user nova-compute[74959]: INFO nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host capabilities <capabilities>
Nov 28 22:54:38 user nova-compute[74959]:   <host>
Nov 28 22:54:38 user nova-compute[74959]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 22:54:38 user nova-compute[74959]:     <cpu>
Nov 28 22:54:38 user nova-compute[74959]:       <arch>x86_64</arch>
Nov 28 22:54:38 user nova-compute[74959]:       <model>IvyBridge-IBRS</model>
Nov 28 22:54:38 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:38 user nova-compute[74959]:       <microcode version='1070'/>
Nov 28 22:54:38 user nova-compute[74959]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 22:54:38 user nova-compute[74959]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='ss'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='vmx'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='pcid'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='osxsave'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='hypervisor'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='arat'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='tsc_adjust'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='md-clear'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='stibp'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='arch-capabilities'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='ssbd'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='invtsc'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='rsba'/>
Nov 28 22:54:38 user nova-compute[74959]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 22:54:38 user nova-compute[74959]:       <pages unit='KiB' size='4'/>
Nov 28 22:54:38 user nova-compute[74959]:       <pages unit='KiB' size='2048'/>
Nov 28 22:54:38 user nova-compute[74959]:     </cpu>
Nov 28 22:54:38 user nova-compute[74959]:     <power_management>
Nov 28 22:54:38 user nova-compute[74959]:       <suspend_mem/>
Nov 28 22:54:38 user nova-compute[74959]:       <suspend_disk/>
Nov 28 22:54:38 user nova-compute[74959]:       <suspend_hybrid/>
Nov 28 22:54:38 user nova-compute[74959]:     </power_management>
Nov 28 22:54:38 user nova-compute[74959]:     <iommu support='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     <migration_features>
Nov 28 22:54:38 user nova-compute[74959]:       <live/>
Nov 28 22:54:38 user nova-compute[74959]:       <uri_transports>
Nov 28 22:54:38 user nova-compute[74959]:         <uri_transport>tcp</uri_transport>
Nov 28 22:54:38 user nova-compute[74959]:         <uri_transport>rdma</uri_transport>
Nov 28 22:54:38 user nova-compute[74959]:       </uri_transports>
Nov 28 22:54:38 user nova-compute[74959]:     </migration_features>
Nov 28 22:54:38 user nova-compute[74959]:     <topology>
Nov 28 22:54:38 user nova-compute[74959]:       <cells num='2'>
Nov 28 22:54:38 user nova-compute[74959]:         <cell id='0'>
Nov 28 22:54:38 user nova-compute[74959]:           <memory unit='KiB'>8140616</memory>
Nov 28 22:54:38 user nova-compute[74959]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 28 22:54:38 user nova-compute[74959]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 22:54:38 user nova-compute[74959]:           <distances>
Nov 28 22:54:38 user nova-compute[74959]:             <sibling id='0' value='10'/>
Nov 28 22:54:38 user nova-compute[74959]:             <sibling id='1' value='20'/>
Nov 28 22:54:38 user nova-compute[74959]:           </distances>
Nov 28 22:54:38 user nova-compute[74959]:           <cpus num='6'>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 22:54:38 user nova-compute[74959]:           </cpus>
Nov 28 22:54:38 user nova-compute[74959]:         </cell>
Nov 28 22:54:38 user nova-compute[74959]:         <cell id='1'>
Nov 28 22:54:38 user nova-compute[74959]:           <memory unit='KiB'>8255068</memory>
Nov 28 22:54:38 user nova-compute[74959]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 28 22:54:38 user nova-compute[74959]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 22:54:38 user nova-compute[74959]:           <distances>
Nov 28 22:54:38 user nova-compute[74959]:             <sibling id='0' value='20'/>
Nov 28 22:54:38 user nova-compute[74959]:             <sibling id='1' value='10'/>
Nov 28 22:54:38 user nova-compute[74959]:           </distances>
Nov 28 22:54:38 user nova-compute[74959]:           <cpus num='6'>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 22:54:38 user nova-compute[74959]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 22:54:38 user nova-compute[74959]:           </cpus>
Nov 28 22:54:38 user nova-compute[74959]:         </cell>
Nov 28 22:54:38 user nova-compute[74959]:       </cells>
Nov 28 22:54:38 user nova-compute[74959]:     </topology>
Nov 28 22:54:38 user nova-compute[74959]:     <cache>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 22:54:38 user nova-compute[74959]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 22:54:38 user nova-compute[74959]:     </cache>
Nov 28 22:54:38 user nova-compute[74959]:     <secmodel>
Nov 28 22:54:38 user nova-compute[74959]:       <model>apparmor</model>
Nov 28 22:54:38 user nova-compute[74959]:       <doi>0</doi>
Nov 28 22:54:38 user nova-compute[74959]:     </secmodel>
Nov 28 22:54:38 user nova-compute[74959]:     <secmodel>
Nov 28 22:54:38 user nova-compute[74959]:       <model>dac</model>
Nov 28 22:54:38 user nova-compute[74959]:       <doi>0</doi>
Nov 28 22:54:38 user nova-compute[74959]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 22:54:38 user nova-compute[74959]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 22:54:38 user nova-compute[74959]:     </secmodel>
Nov 28 22:54:38 user nova-compute[74959]:   </host>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='alpha'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>clipper</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='armv6l'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>spitz</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>nuri</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>kzm</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sx1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>z2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>tosa</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>n810</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>n800</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>terrier</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>midway</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>microbit</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>verdex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>highbank</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>akita</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>connex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>collie</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='armv7l'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>spitz</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>nuri</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>kzm</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sx1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>z2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>tosa</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>n810</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>n800</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>terrier</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>midway</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>microbit</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>verdex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>highbank</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>akita</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>connex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>collie</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='aarch64'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>spitz</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>nuri</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>kzm</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sx1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>z2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>tosa</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>n810</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>n800</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>terrier</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>midway</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>microbit</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>verdex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='4'>highbank</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>akita</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>connex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>collie</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <acpi default='on' toggle='yes'/>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='cris'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='i686'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>isapc</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>microvm</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='kvm'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <pae/>
Nov 28 22:54:38 user nova-compute[74959]:       <nonpae/>
Nov 28 22:54:38 user nova-compute[74959]:       <acpi default='on' toggle='yes'/>
Nov 28 22:54:38 user nova-compute[74959]:       <apic default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='m68k'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>an5206</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>q800</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='microblaze'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='microblazeel'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='mips'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='16'>malta</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='mipsel'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='16'>malta</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='mips64'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='16'>malta</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>pica61</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>magnum</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='mips64el'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='16'>malta</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>pica61</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>magnum</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='16'>boston</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='ppc'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mac99</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>40p</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>taihu</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='ppc64'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>taihu</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>40p</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mac99</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:38 user nova-compute[74959]:     </arch>
Nov 28 22:54:38 user nova-compute[74959]:     <features>
Nov 28 22:54:38 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:38 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:38 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:38 user nova-compute[74959]:     </features>
Nov 28 22:54:38 user nova-compute[74959]:   </guest>
Nov 28 22:54:38 user nova-compute[74959]:   <guest>
Nov 28 22:54:38 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:38 user nova-compute[74959]:     <arch name='ppc64le'>
Nov 28 22:54:38 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:38 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>taihu</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>40p</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>mac99</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 22:54:38 user nova-compute[74959]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='riscv32'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='8'>spike</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='8'>virt</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='riscv64'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='8'>spike</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='8'>virt</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='s390x'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='sh4'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>shix</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>r2d</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='sh4eb'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>shix</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>r2d</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='sparc'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>LX</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='sparc64'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>niagara</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='x86_64'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>64</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='1'>isapc</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>microvm</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='kvm'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <acpi default='on' toggle='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:       <apic default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='xtensa'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='4'>sim</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>kc705</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>ml605</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>virt</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>lx200</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>lx60</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]:   <guest>
Nov 28 22:54:39 user nova-compute[74959]:     <os_type>hvm</os_type>
Nov 28 22:54:39 user nova-compute[74959]:     <arch name='xtensaeb'>
Nov 28 22:54:39 user nova-compute[74959]:       <wordsize>32</wordsize>
Nov 28 22:54:39 user nova-compute[74959]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='4'>sim</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>kc705</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>ml605</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>virt</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>lx200</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>lx60</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 22:54:39 user nova-compute[74959]:       <domain type='qemu'/>
Nov 28 22:54:39 user nova-compute[74959]:     </arch>
Nov 28 22:54:39 user nova-compute[74959]:     <features>
Nov 28 22:54:39 user nova-compute[74959]:       <cpuselection/>
Nov 28 22:54:39 user nova-compute[74959]:       <deviceboot/>
Nov 28 22:54:39 user nova-compute[74959]:       <disksnapshot default='on' toggle='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     </features>
Nov 28 22:54:39 user nova-compute[74959]:   </guest>
Nov 28 22:54:39 user nova-compute[74959]: </capabilities>
Nov 28 22:54:39 user nova-compute[74959]: 
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 22:54:39 user nova-compute[74959]: <domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 22:54:39 user nova-compute[74959]:   <domain>kvm</domain>
Nov 28 22:54:39 user nova-compute[74959]:   <machine>pc-q35-6.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>i686</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <vcpu max='288'/>
Nov 28 22:54:39 user nova-compute[74959]:   <iothreads supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:   <os supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='firmware'/>
Nov 28 22:54:39 user nova-compute[74959]:     <loader supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>rom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pflash</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='readonly'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='secure'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </loader>
Nov 28 22:54:39 user nova-compute[74959]:   </os>
Nov 28 22:54:39 user nova-compute[74959]:   <cpu>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-passthrough' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='hostPassthroughMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='maximum' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='maximumMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-model' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ss'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='vmx'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pcid'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='hypervisor'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arat'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='umip'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='md-clear'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibpb'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibrs'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='erms'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='lm'/>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='custom' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>qemu64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>qemu32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>phenom</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>n270</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>kvm64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>coreduo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>core2duo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>athlon</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Westmere</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Snowridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Penryn</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G5</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G4</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G1</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Rome</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Milan</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Dhyana</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cooperlake</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Conroe</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>486</model>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:   </cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <memoryBacking supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='sourceType'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>file</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>anonymous</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>memfd</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:   </memoryBacking>
Nov 28 22:54:39 user nova-compute[74959]:   <devices>
Nov 28 22:54:39 user nova-compute[74959]:     <disk supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='diskDevice'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>disk</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cdrom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>floppy</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>lun</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='bus'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>fdc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sata</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </disk>
Nov 28 22:54:39 user nova-compute[74959]:     <graphics supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sdl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vnc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>spice</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egl-headless</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </graphics>
Nov 28 22:54:39 user nova-compute[74959]:     <video supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='modelType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cirrus</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vmvga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>qxl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>none</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>bochs</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ramfb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </video>
Nov 28 22:54:39 user nova-compute[74959]:     <hostdev supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='mode'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>subsystem</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='startupPolicy'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>default</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>mandatory</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>requisite</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>optional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='subsysType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pci</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='capsType'/>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='pciBackend'/>
Nov 28 22:54:39 user nova-compute[74959]:     </hostdev>
Nov 28 22:54:39 user nova-compute[74959]:     <rng supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>random</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egd</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>builtin</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </rng>
Nov 28 22:54:39 user nova-compute[74959]:     <filesystem supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='driverType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>path</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>handle</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtiofs</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </filesystem>
Nov 28 22:54:39 user nova-compute[74959]:     <tpm supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-tis</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-crb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>passthrough</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>emulator</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </tpm>
Nov 28 22:54:39 user nova-compute[74959]:   </devices>
Nov 28 22:54:39 user nova-compute[74959]:   <features>
Nov 28 22:54:39 user nova-compute[74959]:     <gic supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     <vmcoreinfo supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <genid supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backingStoreInput supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backup supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <sev supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:   </features>
Nov 28 22:54:39 user nova-compute[74959]: </domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 22:54:39 user nova-compute[74959]: <domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 22:54:39 user nova-compute[74959]:   <domain>kvm</domain>
Nov 28 22:54:39 user nova-compute[74959]:   <machine>pc-q35-jammy</machine>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>i686</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <vcpu max='288'/>
Nov 28 22:54:39 user nova-compute[74959]:   <iothreads supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:   <os supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='firmware'/>
Nov 28 22:54:39 user nova-compute[74959]:     <loader supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>rom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pflash</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='readonly'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='secure'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </loader>
Nov 28 22:54:39 user nova-compute[74959]:   </os>
Nov 28 22:54:39 user nova-compute[74959]:   <cpu>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-passthrough' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='hostPassthroughMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='maximum' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='maximumMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-model' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ss'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='vmx'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pcid'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='hypervisor'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arat'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='umip'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='md-clear'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibpb'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibrs'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='erms'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='lm'/>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='custom' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>qemu64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>qemu32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>phenom</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>n270</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>kvm64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>coreduo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>core2duo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>athlon</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Westmere</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Snowridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Penryn</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G5</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G4</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G1</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Rome</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Milan</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Dhyana</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cooperlake</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Conroe</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>486</model>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:   </cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <memoryBacking supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='sourceType'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>file</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>anonymous</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>memfd</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:   </memoryBacking>
Nov 28 22:54:39 user nova-compute[74959]:   <devices>
Nov 28 22:54:39 user nova-compute[74959]:     <disk supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='diskDevice'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>disk</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cdrom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>floppy</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>lun</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='bus'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>fdc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sata</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </disk>
Nov 28 22:54:39 user nova-compute[74959]:     <graphics supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sdl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vnc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>spice</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egl-headless</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </graphics>
Nov 28 22:54:39 user nova-compute[74959]:     <video supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='modelType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cirrus</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vmvga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>qxl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>none</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>bochs</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ramfb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </video>
Nov 28 22:54:39 user nova-compute[74959]:     <hostdev supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='mode'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>subsystem</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='startupPolicy'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>default</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>mandatory</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>requisite</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>optional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='subsysType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pci</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='capsType'/>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='pciBackend'/>
Nov 28 22:54:39 user nova-compute[74959]:     </hostdev>
Nov 28 22:54:39 user nova-compute[74959]:     <rng supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>random</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egd</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>builtin</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </rng>
Nov 28 22:54:39 user nova-compute[74959]:     <filesystem supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='driverType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>path</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>handle</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtiofs</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </filesystem>
Nov 28 22:54:39 user nova-compute[74959]:     <tpm supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-tis</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-crb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>passthrough</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>emulator</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </tpm>
Nov 28 22:54:39 user nova-compute[74959]:   </devices>
Nov 28 22:54:39 user nova-compute[74959]:   <features>
Nov 28 22:54:39 user nova-compute[74959]:     <gic supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     <vmcoreinfo supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <genid supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backingStoreInput supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backup supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <sev supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:   </features>
Nov 28 22:54:39 user nova-compute[74959]: </domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 22:54:39 user nova-compute[74959]: <domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 22:54:39 user nova-compute[74959]:   <domain>kvm</domain>
Nov 28 22:54:39 user nova-compute[74959]:   <machine>pc-i440fx-jammy</machine>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>i686</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <vcpu max='255'/>
Nov 28 22:54:39 user nova-compute[74959]:   <iothreads supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:   <os supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='firmware'/>
Nov 28 22:54:39 user nova-compute[74959]:     <loader supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>rom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pflash</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='readonly'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='secure'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </loader>
Nov 28 22:54:39 user nova-compute[74959]:   </os>
Nov 28 22:54:39 user nova-compute[74959]:   <cpu>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-passthrough' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='hostPassthroughMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='maximum' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='maximumMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-model' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ss'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='vmx'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pcid'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='hypervisor'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arat'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='umip'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='md-clear'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibpb'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibrs'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='erms'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='lm'/>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='custom' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>qemu64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>qemu32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>phenom</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>n270</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>kvm64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>coreduo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>core2duo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>athlon</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Westmere</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Snowridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Penryn</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G5</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G4</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G1</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Rome</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Milan</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Dhyana</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cooperlake</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Conroe</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>486</model>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:   </cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <memoryBacking supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='sourceType'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>file</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>anonymous</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>memfd</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:   </memoryBacking>
Nov 28 22:54:39 user nova-compute[74959]:   <devices>
Nov 28 22:54:39 user nova-compute[74959]:     <disk supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='diskDevice'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>disk</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cdrom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>floppy</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>lun</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='bus'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ide</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>fdc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sata</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </disk>
Nov 28 22:54:39 user nova-compute[74959]:     <graphics supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sdl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vnc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>spice</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egl-headless</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </graphics>
Nov 28 22:54:39 user nova-compute[74959]:     <video supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='modelType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cirrus</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vmvga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>qxl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>none</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>bochs</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ramfb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </video>
Nov 28 22:54:39 user nova-compute[74959]:     <hostdev supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='mode'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>subsystem</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='startupPolicy'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>default</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>mandatory</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>requisite</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>optional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='subsysType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pci</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='capsType'/>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='pciBackend'/>
Nov 28 22:54:39 user nova-compute[74959]:     </hostdev>
Nov 28 22:54:39 user nova-compute[74959]:     <rng supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>random</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egd</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>builtin</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </rng>
Nov 28 22:54:39 user nova-compute[74959]:     <filesystem supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='driverType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>path</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>handle</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtiofs</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </filesystem>
Nov 28 22:54:39 user nova-compute[74959]:     <tpm supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-tis</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-crb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>passthrough</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>emulator</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </tpm>
Nov 28 22:54:39 user nova-compute[74959]:   </devices>
Nov 28 22:54:39 user nova-compute[74959]:   <features>
Nov 28 22:54:39 user nova-compute[74959]:     <gic supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     <vmcoreinfo supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <genid supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backingStoreInput supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backup supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <sev supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:   </features>
Nov 28 22:54:39 user nova-compute[74959]: </domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 22:54:39 user nova-compute[74959]: <domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 22:54:39 user nova-compute[74959]:   <domain>kvm</domain>
Nov 28 22:54:39 user nova-compute[74959]:   <machine>pc-i440fx-6.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>i686</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <vcpu max='255'/>
Nov 28 22:54:39 user nova-compute[74959]:   <iothreads supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:   <os supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='firmware'/>
Nov 28 22:54:39 user nova-compute[74959]:     <loader supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>rom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pflash</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='readonly'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='secure'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </loader>
Nov 28 22:54:39 user nova-compute[74959]:   </os>
Nov 28 22:54:39 user nova-compute[74959]:   <cpu>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-passthrough' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='hostPassthroughMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='maximum' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='maximumMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-model' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ss'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='vmx'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pcid'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='hypervisor'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arat'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='umip'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='md-clear'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibpb'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibrs'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='erms'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='lm'/>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='custom' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>qemu64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>qemu32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>phenom</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>n270</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>kvm64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>coreduo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>core2duo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>athlon</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Westmere</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Snowridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Penryn</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G5</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G4</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G1</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Rome</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Milan</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Dhyana</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cooperlake</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Conroe</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>486</model>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:   </cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <memoryBacking supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='sourceType'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>file</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>anonymous</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>memfd</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:   </memoryBacking>
Nov 28 22:54:39 user nova-compute[74959]:   <devices>
Nov 28 22:54:39 user nova-compute[74959]:     <disk supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='diskDevice'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>disk</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cdrom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>floppy</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>lun</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='bus'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ide</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>fdc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sata</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </disk>
Nov 28 22:54:39 user nova-compute[74959]:     <graphics supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sdl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vnc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>spice</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egl-headless</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </graphics>
Nov 28 22:54:39 user nova-compute[74959]:     <video supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='modelType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cirrus</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vmvga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>qxl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>none</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>bochs</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ramfb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </video>
Nov 28 22:54:39 user nova-compute[74959]:     <hostdev supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='mode'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>subsystem</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='startupPolicy'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>default</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>mandatory</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>requisite</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>optional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='subsysType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pci</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='capsType'/>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='pciBackend'/>
Nov 28 22:54:39 user nova-compute[74959]:     </hostdev>
Nov 28 22:54:39 user nova-compute[74959]:     <rng supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>random</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egd</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>builtin</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </rng>
Nov 28 22:54:39 user nova-compute[74959]:     <filesystem supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='driverType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>path</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>handle</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtiofs</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </filesystem>
Nov 28 22:54:39 user nova-compute[74959]:     <tpm supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-tis</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-crb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>passthrough</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>emulator</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </tpm>
Nov 28 22:54:39 user nova-compute[74959]:   </devices>
Nov 28 22:54:39 user nova-compute[74959]:   <features>
Nov 28 22:54:39 user nova-compute[74959]:     <gic supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     <vmcoreinfo supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <genid supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backingStoreInput supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backup supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <sev supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:   </features>
Nov 28 22:54:39 user nova-compute[74959]: </domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 22:54:39 user nova-compute[74959]: <domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 22:54:39 user nova-compute[74959]:   <domain>kvm</domain>
Nov 28 22:54:39 user nova-compute[74959]:   <machine>pc-q35-6.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>x86_64</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <vcpu max='288'/>
Nov 28 22:54:39 user nova-compute[74959]:   <iothreads supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:   <os supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='firmware'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>efi</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:     <loader supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>rom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pflash</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='readonly'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='secure'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </loader>
Nov 28 22:54:39 user nova-compute[74959]:   </os>
Nov 28 22:54:39 user nova-compute[74959]:   <cpu>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-passthrough' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='hostPassthroughMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='maximum' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='maximumMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-model' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ss'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='vmx'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pcid'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='hypervisor'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arat'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='umip'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='md-clear'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='invtsc'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibpb'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibrs'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='rsba'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='erms'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='custom' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>qemu64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>qemu32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>phenom</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>n270</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>coreduo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>core2duo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>athlon</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Westmere</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Snowridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Penryn</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G5</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G4</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Opteron_G1</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Rome</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Milan</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Dhyana</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cooperlake</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Conroe</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>486</model>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:   </cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <memoryBacking supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='sourceType'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>file</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>anonymous</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>memfd</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:   </memoryBacking>
Nov 28 22:54:39 user nova-compute[74959]:   <devices>
Nov 28 22:54:39 user nova-compute[74959]:     <disk supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='diskDevice'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>disk</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cdrom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>floppy</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>lun</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='bus'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>fdc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sata</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </disk>
Nov 28 22:54:39 user nova-compute[74959]:     <graphics supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sdl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vnc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>spice</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egl-headless</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </graphics>
Nov 28 22:54:39 user nova-compute[74959]:     <video supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='modelType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cirrus</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vmvga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>qxl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>none</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>bochs</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ramfb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </video>
Nov 28 22:54:39 user nova-compute[74959]:     <hostdev supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='mode'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>subsystem</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='startupPolicy'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>default</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>mandatory</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>requisite</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>optional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='subsysType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pci</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='capsType'/>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='pciBackend'/>
Nov 28 22:54:39 user nova-compute[74959]:     </hostdev>
Nov 28 22:54:39 user nova-compute[74959]:     <rng supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>random</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egd</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>builtin</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </rng>
Nov 28 22:54:39 user nova-compute[74959]:     <filesystem supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='driverType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>path</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>handle</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtiofs</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </filesystem>
Nov 28 22:54:39 user nova-compute[74959]:     <tpm supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-tis</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-crb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>passthrough</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>emulator</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </tpm>
Nov 28 22:54:39 user nova-compute[74959]:   </devices>
Nov 28 22:54:39 user nova-compute[74959]:   <features>
Nov 28 22:54:39 user nova-compute[74959]:     <gic supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     <vmcoreinfo supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <genid supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backingStoreInput supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backup supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <sev supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:   </features>
Nov 28 22:54:39 user nova-compute[74959]: </domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 22:54:39 user nova-compute[74959]: <domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 22:54:39 user nova-compute[74959]:   <domain>kvm</domain>
Nov 28 22:54:39 user nova-compute[74959]:   <machine>pc-q35-jammy</machine>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>x86_64</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <vcpu max='288'/>
Nov 28 22:54:39 user nova-compute[74959]:   <iothreads supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:   <os supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='firmware'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>efi</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:     <loader supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>rom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pflash</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='readonly'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='secure'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </loader>
Nov 28 22:54:39 user nova-compute[74959]:   </os>
Nov 28 22:54:39 user nova-compute[74959]:   <cpu>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-passthrough' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='hostPassthroughMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='maximum' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='maximumMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-model' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ss'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='vmx'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pcid'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='hypervisor'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arat'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='umip'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='md-clear'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='invtsc'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibpb'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibrs'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='rsba'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='erms'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='custom' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>qemu64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>qemu32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>phenom</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>n270</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>coreduo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>core2duo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>athlon</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Westmere</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Snowridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Penryn</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G5</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G4</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Opteron_G1</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Rome</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Milan</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Dhyana</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cooperlake</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Conroe</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>486</model>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:   </cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <memoryBacking supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='sourceType'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>file</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>anonymous</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>memfd</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:   </memoryBacking>
Nov 28 22:54:39 user nova-compute[74959]:   <devices>
Nov 28 22:54:39 user nova-compute[74959]:     <disk supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='diskDevice'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>disk</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cdrom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>floppy</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>lun</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='bus'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>fdc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sata</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </disk>
Nov 28 22:54:39 user nova-compute[74959]:     <graphics supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sdl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vnc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>spice</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egl-headless</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </graphics>
Nov 28 22:54:39 user nova-compute[74959]:     <video supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='modelType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cirrus</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vmvga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>qxl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>none</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>bochs</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ramfb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </video>
Nov 28 22:54:39 user nova-compute[74959]:     <hostdev supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='mode'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>subsystem</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='startupPolicy'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>default</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>mandatory</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>requisite</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>optional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='subsysType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pci</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='capsType'/>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='pciBackend'/>
Nov 28 22:54:39 user nova-compute[74959]:     </hostdev>
Nov 28 22:54:39 user nova-compute[74959]:     <rng supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>random</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egd</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>builtin</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </rng>
Nov 28 22:54:39 user nova-compute[74959]:     <filesystem supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='driverType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>path</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>handle</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtiofs</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </filesystem>
Nov 28 22:54:39 user nova-compute[74959]:     <tpm supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-tis</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-crb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>passthrough</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>emulator</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </tpm>
Nov 28 22:54:39 user nova-compute[74959]:   </devices>
Nov 28 22:54:39 user nova-compute[74959]:   <features>
Nov 28 22:54:39 user nova-compute[74959]:     <gic supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     <vmcoreinfo supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <genid supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backingStoreInput supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backup supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <sev supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:   </features>
Nov 28 22:54:39 user nova-compute[74959]: </domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 22:54:39 user nova-compute[74959]: <domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 22:54:39 user nova-compute[74959]:   <domain>kvm</domain>
Nov 28 22:54:39 user nova-compute[74959]:   <machine>pc-i440fx-jammy</machine>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>x86_64</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <vcpu max='255'/>
Nov 28 22:54:39 user nova-compute[74959]:   <iothreads supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:   <os supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='firmware'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>efi</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:     <loader supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>rom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pflash</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='readonly'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='secure'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </loader>
Nov 28 22:54:39 user nova-compute[74959]:   </os>
Nov 28 22:54:39 user nova-compute[74959]:   <cpu>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-passthrough' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='hostPassthroughMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='maximum' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='maximumMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-model' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ss'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='vmx'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pcid'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='hypervisor'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arat'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='umip'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='md-clear'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='invtsc'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibpb'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibrs'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='rsba'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='erms'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='custom' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>qemu64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>qemu32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>phenom</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>n270</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>coreduo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>core2duo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>athlon</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Westmere</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Snowridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Penryn</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G5</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G4</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Opteron_G1</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Rome</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Milan</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Dhyana</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cooperlake</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Conroe</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>486</model>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:   </cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <memoryBacking supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='sourceType'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>file</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>anonymous</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>memfd</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:   </memoryBacking>
Nov 28 22:54:39 user nova-compute[74959]:   <devices>
Nov 28 22:54:39 user nova-compute[74959]:     <disk supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='diskDevice'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>disk</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cdrom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>floppy</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>lun</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='bus'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ide</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>fdc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sata</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </disk>
Nov 28 22:54:39 user nova-compute[74959]:     <graphics supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sdl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vnc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>spice</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egl-headless</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </graphics>
Nov 28 22:54:39 user nova-compute[74959]:     <video supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='modelType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cirrus</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vmvga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>qxl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>none</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>bochs</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ramfb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </video>
Nov 28 22:54:39 user nova-compute[74959]:     <hostdev supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='mode'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>subsystem</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='startupPolicy'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>default</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>mandatory</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>requisite</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>optional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='subsysType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pci</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='capsType'/>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='pciBackend'/>
Nov 28 22:54:39 user nova-compute[74959]:     </hostdev>
Nov 28 22:54:39 user nova-compute[74959]:     <rng supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>random</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egd</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>builtin</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </rng>
Nov 28 22:54:39 user nova-compute[74959]:     <filesystem supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='driverType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>path</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>handle</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtiofs</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </filesystem>
Nov 28 22:54:39 user nova-compute[74959]:     <tpm supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-tis</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-crb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>passthrough</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>emulator</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </tpm>
Nov 28 22:54:39 user nova-compute[74959]:   </devices>
Nov 28 22:54:39 user nova-compute[74959]:   <features>
Nov 28 22:54:39 user nova-compute[74959]:     <gic supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     <vmcoreinfo supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <genid supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backingStoreInput supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backup supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <sev supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:   </features>
Nov 28 22:54:39 user nova-compute[74959]: </domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 22:54:39 user nova-compute[74959]: <domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 22:54:39 user nova-compute[74959]:   <domain>kvm</domain>
Nov 28 22:54:39 user nova-compute[74959]:   <machine>pc-i440fx-6.2</machine>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>x86_64</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <vcpu max='255'/>
Nov 28 22:54:39 user nova-compute[74959]:   <iothreads supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:   <os supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='firmware'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>efi</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:     <loader supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>rom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pflash</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='readonly'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>yes</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='secure'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>no</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </loader>
Nov 28 22:54:39 user nova-compute[74959]:   </os>
Nov 28 22:54:39 user nova-compute[74959]:   <cpu>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-passthrough' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='hostPassthroughMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='maximum' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='maximumMigratable'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>on</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>off</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='host-model' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ss'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='vmx'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pcid'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='hypervisor'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arat'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='umip'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='md-clear'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='invtsc'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibpb'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='ibrs'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-stibp'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='rsba'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='erms'/>
Nov 28 22:54:39 user nova-compute[74959]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:     <mode name='custom' supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>qemu64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>qemu32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>phenom</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>pentium</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>n270</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm64</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>kvm32</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>coreduo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>core2duo</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>athlon</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Westmere</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Snowridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Skylake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>SandyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Penryn</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G5</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G4</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G3</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Opteron_G2</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Opteron_G1</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>IvyBridge</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Icelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Haswell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Rome</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-Milan</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>EPYC</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Dhyana</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cooperlake</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>Conroe</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='no'>Broadwell</model>
Nov 28 22:54:39 user nova-compute[74959]:       <model usable='yes'>486</model>
Nov 28 22:54:39 user nova-compute[74959]:     </mode>
Nov 28 22:54:39 user nova-compute[74959]:   </cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <memoryBacking supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:     <enum name='sourceType'>
Nov 28 22:54:39 user nova-compute[74959]:       <value>file</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>anonymous</value>
Nov 28 22:54:39 user nova-compute[74959]:       <value>memfd</value>
Nov 28 22:54:39 user nova-compute[74959]:     </enum>
Nov 28 22:54:39 user nova-compute[74959]:   </memoryBacking>
Nov 28 22:54:39 user nova-compute[74959]:   <devices>
Nov 28 22:54:39 user nova-compute[74959]:     <disk supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='diskDevice'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>disk</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cdrom</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>floppy</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>lun</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='bus'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ide</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>fdc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sata</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </disk>
Nov 28 22:54:39 user nova-compute[74959]:     <graphics supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='type'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>sdl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vnc</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>spice</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egl-headless</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </graphics>
Nov 28 22:54:39 user nova-compute[74959]:     <video supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='modelType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>cirrus</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>vmvga</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>qxl</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>none</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>bochs</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>ramfb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </video>
Nov 28 22:54:39 user nova-compute[74959]:     <hostdev supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='mode'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>subsystem</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='startupPolicy'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>default</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>mandatory</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>requisite</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>optional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='subsysType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>usb</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>pci</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>scsi</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='capsType'/>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='pciBackend'/>
Nov 28 22:54:39 user nova-compute[74959]:     </hostdev>
Nov 28 22:54:39 user nova-compute[74959]:     <rng supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtio-non-transitional</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>random</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>egd</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>builtin</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </rng>
Nov 28 22:54:39 user nova-compute[74959]:     <filesystem supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='driverType'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>path</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>handle</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>virtiofs</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </filesystem>
Nov 28 22:54:39 user nova-compute[74959]:     <tpm supported='yes'>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='model'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-tis</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>tpm-crb</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:       <enum name='backendModel'>
Nov 28 22:54:39 user nova-compute[74959]:         <value>passthrough</value>
Nov 28 22:54:39 user nova-compute[74959]:         <value>emulator</value>
Nov 28 22:54:39 user nova-compute[74959]:       </enum>
Nov 28 22:54:39 user nova-compute[74959]:     </tpm>
Nov 28 22:54:39 user nova-compute[74959]:   </devices>
Nov 28 22:54:39 user nova-compute[74959]:   <features>
Nov 28 22:54:39 user nova-compute[74959]:     <gic supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:     <vmcoreinfo supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <genid supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backingStoreInput supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <backup supported='yes'/>
Nov 28 22:54:39 user nova-compute[74959]:     <sev supported='no'/>
Nov 28 22:54:39 user nova-compute[74959]:   </features>
Nov 28 22:54:39 user nova-compute[74959]: </domainCapabilities>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74959) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74959) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Checking secure boot support for host arch (x86_64) {{(pid=74959) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 22:54:39 user nova-compute[74959]: INFO nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Secure Boot support detected
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] cpu compare xml: <cpu match="exact">
Nov 28 22:54:39 user nova-compute[74959]:   <model>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]: </cpu>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 22:54:39 user nova-compute[74959]: INFO nova.virt.node [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Generated node identity 54851fe4-2867-4d3c-b2f3-bede5755a160
Nov 28 22:54:39 user nova-compute[74959]: INFO nova.virt.node [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Wrote node identity 54851fe4-2867-4d3c-b2f3-bede5755a160 to /opt/stack/data/nova/compute_id
Nov 28 22:54:39 user nova-compute[74959]: WARNING nova.compute.manager [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Compute nodes ['54851fe4-2867-4d3c-b2f3-bede5755a160'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 22:54:39 user nova-compute[74959]: INFO nova.compute.manager [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 22:54:39 user nova-compute[74959]: WARNING nova.compute.manager [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 22:54:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 22:54:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:54:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Hypervisor/Node resource view: name=user free_ram=10967MB free_disk=26.212905883789062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:54:39 user nova-compute[74959]: WARNING nova.compute.resource_tracker [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] No compute node record for user:54851fe4-2867-4d3c-b2f3-bede5755a160: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 54851fe4-2867-4d3c-b2f3-bede5755a160 could not be found.
Nov 28 22:54:39 user nova-compute[74959]: INFO nova.compute.resource_tracker [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Compute node record created for user:user with uuid: 54851fe4-2867-4d3c-b2f3-bede5755a160
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 22:54:39 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] [req-323ab1f4-365e-4205-a4a6-197cff641e33] Created resource provider record via placement API for resource provider with UUID 54851fe4-2867-4d3c-b2f3-bede5755a160 and name user.
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74959) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 22:54:39 user nova-compute[74959]: INFO nova.virt.libvirt.host [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] kernel doesn't support AMD SEV
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:54:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Libvirt baseline CPU <cpu>
Nov 28 22:54:39 user nova-compute[74959]:   <arch>x86_64</arch>
Nov 28 22:54:39 user nova-compute[74959]:   <model>Nehalem</model>
Nov 28 22:54:39 user nova-compute[74959]:   <vendor>Intel</vendor>
Nov 28 22:54:39 user nova-compute[74959]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 22:54:39 user nova-compute[74959]: </cpu>
Nov 28 22:54:39 user nova-compute[74959]:  {{(pid=74959) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Updated inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Updating resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 generation from 0 to 1 during operation: update_inventory {{(pid=74959) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Updating resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 generation from 1 to 2 during operation: update_traits {{(pid=74959) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG nova.service [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Creating RPC server for service compute {{(pid=74959) start /opt/stack/nova/nova/service.py:182}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG nova.service [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] Join ServiceGroup membership for this service compute {{(pid=74959) start /opt/stack/nova/nova/service.py:199}}
Nov 28 22:54:40 user nova-compute[74959]: DEBUG nova.servicegroup.drivers.db [None req-4097123c-1ed9-464e-bc2c-4c1405f8701d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74959) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 22:55:38 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:55:38 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=10269MB free_disk=26.116535186767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:55:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 22:56:31 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:56:31 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=10317MB free_disk=26.18157958984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:56:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:56:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 22:56:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:56:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:56:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 22:57:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 22:57:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 22:57:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 22:57:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 22:57:32 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:57:32 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:57:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=10298MB free_disk=25.933483123779297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:57:32 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:57:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 22:57:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:57:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:57:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 22:58:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 22:58:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 22:58:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 22:58:32 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:32 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9663MB free_disk=25.962642669677734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 22:58:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 22:58:33 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:58:33 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:58:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 22:58:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:58:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 22:58:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:58:42 user nova-compute[74959]: INFO nova.compute.claims [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Claim successful on node user
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.186s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:58:42 user nova-compute[74959]: INFO nova.compute.claims [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Claim successful on node user
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:58:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:58:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Creating image(s)
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "/opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "/opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "/opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.network.neutron [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:58:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:58:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:58:43 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Creating image(s)
Nov 28 22:58:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "/opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "/opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG nova.policy [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8d218abbe14f27b754f1fffd9553f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da22f0050e34c9b9a7658f16c08f28b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG nova.policy [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '319383d7dcac476fbe51683e055a5cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19211f3f50842619c64ccda7af2187f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG nova.virt.images [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] dd44e43d-57fb-483e-b625-10657e7fc425 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 22:58:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8.part /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8.part /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8.converted" returned: 0 in 0.152s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.462s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:44 user nova-compute[74959]: INFO oslo.privsep.daemon [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyg517l1_/privsep.sock']
Nov 28 22:58:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.191s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:44 user sudo[84433]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyg517l1_/privsep.sock
Nov 28 22:58:44 user sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 22:58:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Successfully created port: 1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:58:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Successfully created port: c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:58:45 user sudo[84433]: pam_unix(sudo:session): session closed for user root
Nov 28 22:58:45 user nova-compute[74959]: INFO oslo.privsep.daemon [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Spawned new privsep daemon via rootwrap
Nov 28 22:58:45 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 22:58:45 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 22:58:45 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 22:58:45 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84437
Nov 28 22:58:45 user nova-compute[74959]: WARNING oslo_privsep.priv_context [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] privsep daemon already running
Nov 28 22:58:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.160s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.168s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.159s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk 1073741824" returned: 0 in 0.039s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.195s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.169s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.228s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk 1073741824" returned: 0 in 0.060s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Cannot resize image /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Ensure instance console log exists: /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Cannot resize image /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Ensure instance console log exists: /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:58:47 user nova-compute[74959]: INFO nova.compute.claims [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Claim successful on node user
Nov 28 22:58:47 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:58:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:58:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:58:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:58:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Creating image(s)
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "/opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "/opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.policy [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f0d2814e7e4df6904596bc07befe0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c57e434911c407189c1801142c226e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.170s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Successfully updated port: c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquired lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:58:48 user nova-compute[74959]: INFO nova.compute.claims [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Claim successful on node user
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk 1073741824" returned: 0 in 0.056s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Successfully updated port: 1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Cannot resize image /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Ensure instance console log exists: /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquired lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-5b0529e9-ba68-4b71-bf98-83f13fb02f82 req-8c5cc8cb-06d0-4547-8167-d1e5b2af82e9 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received event network-changed-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-5b0529e9-ba68-4b71-bf98-83f13fb02f82 req-8c5cc8cb-06d0-4547-8167-d1e5b2af82e9 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Refreshing instance network info cache due to event network-changed-c002f120-e445-4832-b505-e442b42a7dce. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:58:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5b0529e9-ba68-4b71-bf98-83f13fb02f82 req-8c5cc8cb-06d0-4547-8167-d1e5b2af82e9 service nova] Acquiring lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.570s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:58:49 user nova-compute[74959]: INFO nova.compute.claims [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Claim successful on node user
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:58:49 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.neutron [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:58:49 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Creating image(s)
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.policy [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecd0185bcfae4e058dade500ad82dbd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef225be98f448b69f250a21c002c237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updating instance_info_cache with network_info: [{"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.158s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Releasing lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Instance network_info: |[{"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5b0529e9-ba68-4b71-bf98-83f13fb02f82 req-8c5cc8cb-06d0-4547-8167-d1e5b2af82e9 service nova] Acquired lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.neutron [req-5b0529e9-ba68-4b71-bf98-83f13fb02f82 req-8c5cc8cb-06d0-4547-8167-d1e5b2af82e9 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Refreshing network info cache for port c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Start _get_guest_xml network_info=[{"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk 1073741824" returned: 0 in 0.086s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:58:49 user nova-compute[74959]: INFO nova.compute.claims [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Claim successful on node user
Nov 28 22:58:49 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:58:49 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:49 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1138376429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1138376429',id=1,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-gmhous2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:43Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=598c6a68-9826-4fc1-a6ee-17eafd5b14e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d4:6d,bridge_name='br-int',has_traffic_filtering=True,id=c002f120-e445-4832-b505-e442b42a7dce,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc002f120-e4') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.objects.instance [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'pci_devices' on Instance uuid 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:58:49 user nova-compute[74959]:   <uuid>598c6a68-9826-4fc1-a6ee-17eafd5b14e8</uuid>
Nov 28 22:58:49 user nova-compute[74959]:   <name>instance-00000001</name>
Nov 28 22:58:49 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:58:49 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:58:49 user nova-compute[74959]:   <metadata>
Nov 28 22:58:49 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:58:49 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:58:49 user nova-compute[74959]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1138376429</nova:name>
Nov 28 22:58:49 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:58:49</nova:creationTime>
Nov 28 22:58:49 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:58:49 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:58:49 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:58:49 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:58:49 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:58:49 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:58:49 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:58:49 user nova-compute[74959]:       <nova:owner>
Nov 28 22:58:49 user nova-compute[74959]:         <nova:user uuid="5a8d218abbe14f27b754f1fffd9553f8">tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member</nova:user>
Nov 28 22:58:49 user nova-compute[74959]:         <nova:project uuid="8da22f0050e34c9b9a7658f16c08f28b">tempest-ServerBootFromVolumeStableRescueTest-1156029205</nova:project>
Nov 28 22:58:49 user nova-compute[74959]:       </nova:owner>
Nov 28 22:58:49 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:58:49 user nova-compute[74959]:       <nova:ports>
Nov 28 22:58:49 user nova-compute[74959]:         <nova:port uuid="c002f120-e445-4832-b505-e442b42a7dce">
Nov 28 22:58:49 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 22:58:49 user nova-compute[74959]:         </nova:port>
Nov 28 22:58:49 user nova-compute[74959]:       </nova:ports>
Nov 28 22:58:49 user nova-compute[74959]:     </nova:instance>
Nov 28 22:58:49 user nova-compute[74959]:   </metadata>
Nov 28 22:58:49 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:58:49 user nova-compute[74959]:     <system>
Nov 28 22:58:49 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:58:49 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:58:49 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:58:49 user nova-compute[74959]:       <entry name="serial">598c6a68-9826-4fc1-a6ee-17eafd5b14e8</entry>
Nov 28 22:58:49 user nova-compute[74959]:       <entry name="uuid">598c6a68-9826-4fc1-a6ee-17eafd5b14e8</entry>
Nov 28 22:58:49 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:58:49 user nova-compute[74959]:     </system>
Nov 28 22:58:49 user nova-compute[74959]:   </sysinfo>
Nov 28 22:58:49 user nova-compute[74959]:   <os>
Nov 28 22:58:49 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:58:49 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:58:49 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:58:49 user nova-compute[74959]:   </os>
Nov 28 22:58:49 user nova-compute[74959]:   <features>
Nov 28 22:58:49 user nova-compute[74959]:     <acpi/>
Nov 28 22:58:49 user nova-compute[74959]:     <apic/>
Nov 28 22:58:49 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:58:49 user nova-compute[74959]:   </features>
Nov 28 22:58:49 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:58:49 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:58:49 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:58:49 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:58:49 user nova-compute[74959]:   </clock>
Nov 28 22:58:49 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:58:49 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:58:49 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:58:49 user nova-compute[74959]:   </cpu>
Nov 28 22:58:49 user nova-compute[74959]:   <devices>
Nov 28 22:58:49 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:58:49 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:58:49 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk"/>
Nov 28 22:58:49 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:58:49 user nova-compute[74959]:     </disk>
Nov 28 22:58:49 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:58:49 user nova-compute[74959]:       <mac address="fa:16:3e:c7:d4:6d"/>
Nov 28 22:58:49 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:49 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:58:49 user nova-compute[74959]:       <target dev="tapc002f120-e4"/>
Nov 28 22:58:49 user nova-compute[74959]:     </interface>
Nov 28 22:58:49 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:58:49 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/console.log" append="off"/>
Nov 28 22:58:49 user nova-compute[74959]:     </serial>
Nov 28 22:58:49 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:58:49 user nova-compute[74959]:     <video>
Nov 28 22:58:49 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:49 user nova-compute[74959]:     </video>
Nov 28 22:58:49 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:58:49 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:58:49 user nova-compute[74959]:     </rng>
Nov 28 22:58:49 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:58:49 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:58:49 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:58:49 user nova-compute[74959]:     </memballoon>
Nov 28 22:58:49 user nova-compute[74959]:   </devices>
Nov 28 22:58:49 user nova-compute[74959]: </domain>
Nov 28 22:58:49 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1138376429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1138376429',id=1,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-gmhous2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:43Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=598c6a68-9826-4fc1-a6ee-17eafd5b14e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d4:6d,bridge_name='br-int',has_traffic_filtering=True,id=c002f120-e445-4832-b505-e442b42a7dce,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc002f120-e4') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:49 user nova-compute[74959]: DEBUG os_vif [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d4:6d,bridge_name='br-int',has_traffic_filtering=True,id=c002f120-e445-4832-b505-e442b42a7dce,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc002f120-e4') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Created schema index Interface.name {{(pid=74959) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Created schema index Port.name {{(pid=74959) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Created schema index Bridge.name {{(pid=74959) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.258s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.policy [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '911d51b00a8e442cbe38d5e511edba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e566d89eec64455b5bdb1b105bfe9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [POLLOUT] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Updating instance_info_cache with network_info: [{"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Successfully created port: cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:58:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Creating image(s)
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Releasing lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Instance network_info: |[{"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Start _get_guest_xml network_info=[{"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Cannot resize image /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Ensure instance console log exists: /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6e293f4-99ac-54f8-9a11-475999c1d1f5', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:50 user nova-compute[74959]: INFO oslo.privsep.daemon [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp4mpkm818/privsep.sock']
Nov 28 22:58:50 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:50 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:58:50 user sudo[84510]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp4mpkm818/privsep.sock
Nov 28 22:58:50 user sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-582890100',display_name='tempest-DeleteServersTestJSON-server-582890100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-582890100',id=2,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c19211f3f50842619c64ccda7af2187f',ramdisk_id='',reservation_id='r-44s06uia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-146052557',owner_user_name='tempest-DeleteServersTestJSON-146052557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:43Z,user_data=None,user_id='319383d7dcac476fbe51683e055a5cda',uuid=3e471897-443d-4b80-b60a-dad06cbe21f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Converting VIF {"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:22:16,bridge_name='br-int',has_traffic_filtering=True,id=1b305c28-4e54-427a-95d7-e94f18e768c7,network=Network(3f4c6bd1-9d5c-469c-a484-9f06a1b9b036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b305c28-4e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.objects.instance [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e471897-443d-4b80-b60a-dad06cbe21f9 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:58:50 user nova-compute[74959]:   <uuid>3e471897-443d-4b80-b60a-dad06cbe21f9</uuid>
Nov 28 22:58:50 user nova-compute[74959]:   <name>instance-00000002</name>
Nov 28 22:58:50 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:58:50 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:58:50 user nova-compute[74959]:   <metadata>
Nov 28 22:58:50 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:58:50 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:58:50 user nova-compute[74959]:       <nova:name>tempest-DeleteServersTestJSON-server-582890100</nova:name>
Nov 28 22:58:50 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:58:50</nova:creationTime>
Nov 28 22:58:50 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:58:50 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:58:50 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:58:50 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:58:50 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:58:50 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:58:50 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:58:50 user nova-compute[74959]:       <nova:owner>
Nov 28 22:58:50 user nova-compute[74959]:         <nova:user uuid="319383d7dcac476fbe51683e055a5cda">tempest-DeleteServersTestJSON-146052557-project-member</nova:user>
Nov 28 22:58:50 user nova-compute[74959]:         <nova:project uuid="c19211f3f50842619c64ccda7af2187f">tempest-DeleteServersTestJSON-146052557</nova:project>
Nov 28 22:58:50 user nova-compute[74959]:       </nova:owner>
Nov 28 22:58:50 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:58:50 user nova-compute[74959]:       <nova:ports>
Nov 28 22:58:50 user nova-compute[74959]:         <nova:port uuid="1b305c28-4e54-427a-95d7-e94f18e768c7">
Nov 28 22:58:50 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 22:58:50 user nova-compute[74959]:         </nova:port>
Nov 28 22:58:50 user nova-compute[74959]:       </nova:ports>
Nov 28 22:58:50 user nova-compute[74959]:     </nova:instance>
Nov 28 22:58:50 user nova-compute[74959]:   </metadata>
Nov 28 22:58:50 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:58:50 user nova-compute[74959]:     <system>
Nov 28 22:58:50 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:58:50 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:58:50 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:58:50 user nova-compute[74959]:       <entry name="serial">3e471897-443d-4b80-b60a-dad06cbe21f9</entry>
Nov 28 22:58:50 user nova-compute[74959]:       <entry name="uuid">3e471897-443d-4b80-b60a-dad06cbe21f9</entry>
Nov 28 22:58:50 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:58:50 user nova-compute[74959]:     </system>
Nov 28 22:58:50 user nova-compute[74959]:   </sysinfo>
Nov 28 22:58:50 user nova-compute[74959]:   <os>
Nov 28 22:58:50 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:58:50 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:58:50 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:58:50 user nova-compute[74959]:   </os>
Nov 28 22:58:50 user nova-compute[74959]:   <features>
Nov 28 22:58:50 user nova-compute[74959]:     <acpi/>
Nov 28 22:58:50 user nova-compute[74959]:     <apic/>
Nov 28 22:58:50 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:58:50 user nova-compute[74959]:   </features>
Nov 28 22:58:50 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:58:50 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:58:50 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:58:50 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:58:50 user nova-compute[74959]:   </clock>
Nov 28 22:58:50 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:58:50 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:58:50 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:58:50 user nova-compute[74959]:   </cpu>
Nov 28 22:58:50 user nova-compute[74959]:   <devices>
Nov 28 22:58:50 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:58:50 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:58:50 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk"/>
Nov 28 22:58:50 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:58:50 user nova-compute[74959]:     </disk>
Nov 28 22:58:50 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:58:50 user nova-compute[74959]:       <mac address="fa:16:3e:0d:22:16"/>
Nov 28 22:58:50 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:50 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:58:50 user nova-compute[74959]:       <target dev="tap1b305c28-4e"/>
Nov 28 22:58:50 user nova-compute[74959]:     </interface>
Nov 28 22:58:50 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:58:50 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/console.log" append="off"/>
Nov 28 22:58:50 user nova-compute[74959]:     </serial>
Nov 28 22:58:50 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:58:50 user nova-compute[74959]:     <video>
Nov 28 22:58:50 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:50 user nova-compute[74959]:     </video>
Nov 28 22:58:50 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:58:50 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:58:50 user nova-compute[74959]:     </rng>
Nov 28 22:58:50 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:58:50 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:58:50 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:58:50 user nova-compute[74959]:     </memballoon>
Nov 28 22:58:50 user nova-compute[74959]:   </devices>
Nov 28 22:58:50 user nova-compute[74959]: </domain>
Nov 28 22:58:50 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-582890100',display_name='tempest-DeleteServersTestJSON-server-582890100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-582890100',id=2,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c19211f3f50842619c64ccda7af2187f',ramdisk_id='',reservation_id='r-44s06uia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-146052557',owner_user_name='tempest-DeleteServersTestJSON-146052557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:43Z,user_data=None,user_id='319383d7dcac476fbe51683e055a5cda',uuid=3e471897-443d-4b80-b60a-dad06cbe21f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Converting VIF {"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:22:16,bridge_name='br-int',has_traffic_filtering=True,id=1b305c28-4e54-427a-95d7-e94f18e768c7,network=Network(3f4c6bd1-9d5c-469c-a484-9f06a1b9b036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b305c28-4e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG os_vif [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:22:16,bridge_name='br-int',has_traffic_filtering=True,id=1b305c28-4e54-427a-95d7-e94f18e768c7,network=Network(3f4c6bd1-9d5c-469c-a484-9f06a1b9b036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b305c28-4e') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '681eb67d-c3da-5977-b80c-1757274709a3', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.162s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk 1073741824" returned: 0 in 0.058s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:58:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:58:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Creating image(s)
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.policy [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba2c8fce9ab041ba928f65f59468683e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95b70a9bba84ebc95d6d7aea0d8c649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Cannot resize image /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Ensure instance console log exists: /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.170s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-750023a5-d359-4f96-8cde-1daf627dd1fc req-8e3e7ba5-7e63-4ed4-aeaf-9e6cf72fe690 service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received event network-changed-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-750023a5-d359-4f96-8cde-1daf627dd1fc req-8e3e7ba5-7e63-4ed4-aeaf-9e6cf72fe690 service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Refreshing instance network info cache due to event network-changed-1b305c28-4e54-427a-95d7-e94f18e768c7. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-750023a5-d359-4f96-8cde-1daf627dd1fc req-8e3e7ba5-7e63-4ed4-aeaf-9e6cf72fe690 service nova] Acquiring lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-750023a5-d359-4f96-8cde-1daf627dd1fc req-8e3e7ba5-7e63-4ed4-aeaf-9e6cf72fe690 service nova] Acquired lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.network.neutron [req-750023a5-d359-4f96-8cde-1daf627dd1fc req-8e3e7ba5-7e63-4ed4-aeaf-9e6cf72fe690 service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Refreshing network info cache for port 1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk 1073741824" returned: 0 in 0.041s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Successfully created port: c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Cannot resize image /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Ensure instance console log exists: /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:58:51 user sudo[84510]: pam_unix(sudo:session): session closed for user root
Nov 28 22:58:51 user nova-compute[74959]: INFO oslo.privsep.daemon [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Spawned new privsep daemon via rootwrap
Nov 28 22:58:51 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 22:58:51 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 22:58:51 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 22:58:51 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84540
Nov 28 22:58:51 user nova-compute[74959]: WARNING oslo_privsep.priv_context [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] privsep daemon already running
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.network.neutron [req-5b0529e9-ba68-4b71-bf98-83f13fb02f82 req-8c5cc8cb-06d0-4547-8167-d1e5b2af82e9 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updated VIF entry in instance network info cache for port c002f120-e445-4832-b505-e442b42a7dce. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG nova.network.neutron [req-5b0529e9-ba68-4b71-bf98-83f13fb02f82 req-8c5cc8cb-06d0-4547-8167-d1e5b2af82e9 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updating instance_info_cache with network_info: [{"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5b0529e9-ba68-4b71-bf98-83f13fb02f82 req-8c5cc8cb-06d0-4547-8167-d1e5b2af82e9 service nova] Releasing lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc002f120-e4, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc002f120-e4, col_values=(('qos', UUID('c4fbda99-f13e-4dcd-a6fb-3515fee6e41d')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc002f120-e4, col_values=(('external_ids', {'iface-id': 'c002f120-e445-4832-b505-e442b42a7dce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:d4:6d', 'vm-uuid': '598c6a68-9826-4fc1-a6ee-17eafd5b14e8'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:52 user nova-compute[74959]: INFO os_vif [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d4:6d,bridge_name='br-int',has_traffic_filtering=True,id=c002f120-e445-4832-b505-e442b42a7dce,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc002f120-e4')
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b305c28-4e, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b305c28-4e, col_values=(('qos', UUID('0048fa9d-4b74-4f5e-92c7-196858af676a')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b305c28-4e, col_values=(('external_ids', {'iface-id': '1b305c28-4e54-427a-95d7-e94f18e768c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:22:16', 'vm-uuid': '3e471897-443d-4b80-b60a-dad06cbe21f9'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:52 user nova-compute[74959]: INFO os_vif [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:22:16,bridge_name='br-int',has_traffic_filtering=True,id=1b305c28-4e54-427a-95d7-e94f18e768c7,network=Network(3f4c6bd1-9d5c-469c-a484-9f06a1b9b036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b305c28-4e')
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No VIF found with MAC fa:16:3e:c7:d4:6d, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] No VIF found with MAC fa:16:3e:0d:22:16, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Successfully created port: 67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.network.neutron [req-750023a5-d359-4f96-8cde-1daf627dd1fc req-8e3e7ba5-7e63-4ed4-aeaf-9e6cf72fe690 service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Updated VIF entry in instance network info cache for port 1b305c28-4e54-427a-95d7-e94f18e768c7. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.network.neutron [req-750023a5-d359-4f96-8cde-1daf627dd1fc req-8e3e7ba5-7e63-4ed4-aeaf-9e6cf72fe690 service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Updating instance_info_cache with network_info: [{"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-750023a5-d359-4f96-8cde-1daf627dd1fc req-8e3e7ba5-7e63-4ed4-aeaf-9e6cf72fe690 service nova] Releasing lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.network.neutron [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Successfully updated port: cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquired lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG nova.network.neutron [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:58:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-4b3e4aab-3efa-4caa-90da-f6ac193c5492 req-664d48dd-b746-47b5-9d1e-67d85876d1fd service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received event network-changed-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-4b3e4aab-3efa-4caa-90da-f6ac193c5492 req-664d48dd-b746-47b5-9d1e-67d85876d1fd service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Refreshing instance network info cache due to event network-changed-cf3e934b-c8e7-4432-ae58-fe4282d0d384. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4b3e4aab-3efa-4caa-90da-f6ac193c5492 req-664d48dd-b746-47b5-9d1e-67d85876d1fd service nova] Acquiring lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Successfully updated port: c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquired lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Successfully created port: ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-beb8db51-cbec-49f0-a92d-d79f68bdd8f9 req-0cf6d03c-7a76-4a9d-b7df-af2a0223278b service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-changed-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-beb8db51-cbec-49f0-a92d-d79f68bdd8f9 req-0cf6d03c-7a76-4a9d-b7df-af2a0223278b service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Refreshing instance network info cache due to event network-changed-c60abc7f-b5c7-45ef-a218-d7454c7dbff8. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-beb8db51-cbec-49f0-a92d-d79f68bdd8f9 req-0cf6d03c-7a76-4a9d-b7df-af2a0223278b service nova] Acquiring lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updating instance_info_cache with network_info: [{"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Releasing lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Instance network_info: |[{"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4b3e4aab-3efa-4caa-90da-f6ac193c5492 req-664d48dd-b746-47b5-9d1e-67d85876d1fd service nova] Acquired lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.network.neutron [req-4b3e4aab-3efa-4caa-90da-f6ac193c5492 req-664d48dd-b746-47b5-9d1e-67d85876d1fd service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Refreshing network info cache for port cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Start _get_guest_xml network_info=[{"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:58:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:58:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-982596722',display_name='tempest-AttachVolumeNegativeTest-server-982596722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-982596722',id=3,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlPnwu7GQA2w0/cXM0+s9KGC1jLnZT2BFNvj5QmR/UNUqmBoD+61qTWatpq01dkGykyIDUQsFo8WT01DjQdl+Nw8QCsIOS5HPbEC+NCpPQ6Lq9lP/NKeE/FgZicakhC3g==',key_name='tempest-keypair-1004908184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-3mk5poe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b0:e5,bridge_name='br-int',has_traffic_filtering=True,id=cf3e934b-c8e7-4432-ae58-fe4282d0d384,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3e934b-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:58:54 user nova-compute[74959]:   <uuid>9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe</uuid>
Nov 28 22:58:54 user nova-compute[74959]:   <name>instance-00000003</name>
Nov 28 22:58:54 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:58:54 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:58:54 user nova-compute[74959]:   <metadata>
Nov 28 22:58:54 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:58:54 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeNegativeTest-server-982596722</nova:name>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:58:53</nova:creationTime>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:58:54 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:58:54 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:owner>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:user uuid="11f0d2814e7e4df6904596bc07befe0e">tempest-AttachVolumeNegativeTest-1174707224-project-member</nova:user>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:project uuid="1c57e434911c407189c1801142c226e1">tempest-AttachVolumeNegativeTest-1174707224</nova:project>
Nov 28 22:58:54 user nova-compute[74959]:       </nova:owner>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:ports>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:port uuid="cf3e934b-c8e7-4432-ae58-fe4282d0d384">
Nov 28 22:58:54 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 22:58:54 user nova-compute[74959]:         </nova:port>
Nov 28 22:58:54 user nova-compute[74959]:       </nova:ports>
Nov 28 22:58:54 user nova-compute[74959]:     </nova:instance>
Nov 28 22:58:54 user nova-compute[74959]:   </metadata>
Nov 28 22:58:54 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:58:54 user nova-compute[74959]:     <system>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="serial">9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="uuid">9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:58:54 user nova-compute[74959]:     </system>
Nov 28 22:58:54 user nova-compute[74959]:   </sysinfo>
Nov 28 22:58:54 user nova-compute[74959]:   <os>
Nov 28 22:58:54 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:58:54 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:58:54 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:58:54 user nova-compute[74959]:   </os>
Nov 28 22:58:54 user nova-compute[74959]:   <features>
Nov 28 22:58:54 user nova-compute[74959]:     <acpi/>
Nov 28 22:58:54 user nova-compute[74959]:     <apic/>
Nov 28 22:58:54 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:58:54 user nova-compute[74959]:   </features>
Nov 28 22:58:54 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:58:54 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:58:54 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:58:54 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:58:54 user nova-compute[74959]:   </clock>
Nov 28 22:58:54 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:58:54 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:58:54 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:58:54 user nova-compute[74959]:   </cpu>
Nov 28 22:58:54 user nova-compute[74959]:   <devices>
Nov 28 22:58:54 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:58:54 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:58:54 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk"/>
Nov 28 22:58:54 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:58:54 user nova-compute[74959]:     </disk>
Nov 28 22:58:54 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:58:54 user nova-compute[74959]:       <mac address="fa:16:3e:d7:b0:e5"/>
Nov 28 22:58:54 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:54 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:58:54 user nova-compute[74959]:       <target dev="tapcf3e934b-c8"/>
Nov 28 22:58:54 user nova-compute[74959]:     </interface>
Nov 28 22:58:54 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:58:54 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/console.log" append="off"/>
Nov 28 22:58:54 user nova-compute[74959]:     </serial>
Nov 28 22:58:54 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:58:54 user nova-compute[74959]:     <video>
Nov 28 22:58:54 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:54 user nova-compute[74959]:     </video>
Nov 28 22:58:54 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:58:54 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:58:54 user nova-compute[74959]:     </rng>
Nov 28 22:58:54 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:58:54 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:58:54 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:58:54 user nova-compute[74959]:     </memballoon>
Nov 28 22:58:54 user nova-compute[74959]:   </devices>
Nov 28 22:58:54 user nova-compute[74959]: </domain>
Nov 28 22:58:54 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-982596722',display_name='tempest-AttachVolumeNegativeTest-server-982596722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-982596722',id=3,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlPnwu7GQA2w0/cXM0+s9KGC1jLnZT2BFNvj5QmR/UNUqmBoD+61qTWatpq01dkGykyIDUQsFo8WT01DjQdl+Nw8QCsIOS5HPbEC+NCpPQ6Lq9lP/NKeE/FgZicakhC3g==',key_name='tempest-keypair-1004908184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-3mk5poe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b0:e5,bridge_name='br-int',has_traffic_filtering=True,id=cf3e934b-c8e7-4432-ae58-fe4282d0d384,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3e934b-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG os_vif [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b0:e5,bridge_name='br-int',has_traffic_filtering=True,id=cf3e934b-c8e7-4432-ae58-fe4282d0d384,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3e934b-c8') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f776dc7-4e11-5314-933b-282ce58fe77d', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf3e934b-c8, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf3e934b-c8, col_values=(('qos', UUID('0d0c5a66-d378-459f-a979-ddd694d03d00')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf3e934b-c8, col_values=(('external_ids', {'iface-id': 'cf3e934b-c8e7-4432-ae58-fe4282d0d384', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:b0:e5', 'vm-uuid': '9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: INFO os_vif [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b0:e5,bridge_name='br-int',has_traffic_filtering=True,id=cf3e934b-c8e7-4432-ae58-fe4282d0d384,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3e934b-c8')
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No VIF found with MAC fa:16:3e:d7:b0:e5, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Releasing lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance network_info: |[{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-beb8db51-cbec-49f0-a92d-d79f68bdd8f9 req-0cf6d03c-7a76-4a9d-b7df-af2a0223278b service nova] Acquired lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.neutron [req-beb8db51-cbec-49f0-a92d-d79f68bdd8f9 req-0cf6d03c-7a76-4a9d-b7df-af2a0223278b service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Refreshing network info cache for port c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Start _get_guest_xml network_info=[{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:54 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1352161345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1352161345',id=5,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY4MPQnR0dTjucVmfRDrhSYKQ3fqU/FWP4ALTGw8zlVLwL32IGrGCUHF6lce73hXDH8jVHMwOZD1NSRvG/cdfElX8l2fYUZVksr8R+lEHe8XLHTG3jfGiDtzbAS3EBOcA==',key_name='tempest-keypair-271008495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-oyejk6uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=94b085b2-b298-4780-be94-21f85c799945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'pci_devices' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:58:54 user nova-compute[74959]:   <uuid>94b085b2-b298-4780-be94-21f85c799945</uuid>
Nov 28 22:58:54 user nova-compute[74959]:   <name>instance-00000005</name>
Nov 28 22:58:54 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:58:54 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:58:54 user nova-compute[74959]:   <metadata>
Nov 28 22:58:54 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:58:54 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1352161345</nova:name>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:58:54</nova:creationTime>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:58:54 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:58:54 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:owner>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:user uuid="ecd0185bcfae4e058dade500ad82dbd2">tempest-AttachVolumeShelveTestJSON-533572635-project-member</nova:user>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:project uuid="bef225be98f448b69f250a21c002c237">tempest-AttachVolumeShelveTestJSON-533572635</nova:project>
Nov 28 22:58:54 user nova-compute[74959]:       </nova:owner>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:58:54 user nova-compute[74959]:       <nova:ports>
Nov 28 22:58:54 user nova-compute[74959]:         <nova:port uuid="c60abc7f-b5c7-45ef-a218-d7454c7dbff8">
Nov 28 22:58:54 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 22:58:54 user nova-compute[74959]:         </nova:port>
Nov 28 22:58:54 user nova-compute[74959]:       </nova:ports>
Nov 28 22:58:54 user nova-compute[74959]:     </nova:instance>
Nov 28 22:58:54 user nova-compute[74959]:   </metadata>
Nov 28 22:58:54 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:58:54 user nova-compute[74959]:     <system>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="serial">94b085b2-b298-4780-be94-21f85c799945</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="uuid">94b085b2-b298-4780-be94-21f85c799945</entry>
Nov 28 22:58:54 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:58:54 user nova-compute[74959]:     </system>
Nov 28 22:58:54 user nova-compute[74959]:   </sysinfo>
Nov 28 22:58:54 user nova-compute[74959]:   <os>
Nov 28 22:58:54 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:58:54 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:58:54 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:58:54 user nova-compute[74959]:   </os>
Nov 28 22:58:54 user nova-compute[74959]:   <features>
Nov 28 22:58:54 user nova-compute[74959]:     <acpi/>
Nov 28 22:58:54 user nova-compute[74959]:     <apic/>
Nov 28 22:58:54 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:58:54 user nova-compute[74959]:   </features>
Nov 28 22:58:54 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:58:54 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:58:54 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:58:54 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:58:54 user nova-compute[74959]:   </clock>
Nov 28 22:58:54 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:58:54 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:58:54 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:58:54 user nova-compute[74959]:   </cpu>
Nov 28 22:58:54 user nova-compute[74959]:   <devices>
Nov 28 22:58:54 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:58:54 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:58:54 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk"/>
Nov 28 22:58:54 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:58:54 user nova-compute[74959]:     </disk>
Nov 28 22:58:54 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:58:54 user nova-compute[74959]:       <mac address="fa:16:3e:39:09:03"/>
Nov 28 22:58:54 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:54 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:58:54 user nova-compute[74959]:       <target dev="tapc60abc7f-b5"/>
Nov 28 22:58:54 user nova-compute[74959]:     </interface>
Nov 28 22:58:54 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:58:54 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/console.log" append="off"/>
Nov 28 22:58:54 user nova-compute[74959]:     </serial>
Nov 28 22:58:54 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:58:54 user nova-compute[74959]:     <video>
Nov 28 22:58:54 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:54 user nova-compute[74959]:     </video>
Nov 28 22:58:54 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:58:54 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:58:54 user nova-compute[74959]:     </rng>
Nov 28 22:58:54 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:58:54 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:58:54 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:58:54 user nova-compute[74959]:     </memballoon>
Nov 28 22:58:54 user nova-compute[74959]:   </devices>
Nov 28 22:58:54 user nova-compute[74959]: </domain>
Nov 28 22:58:54 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1352161345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1352161345',id=5,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY4MPQnR0dTjucVmfRDrhSYKQ3fqU/FWP4ALTGw8zlVLwL32IGrGCUHF6lce73hXDH8jVHMwOZD1NSRvG/cdfElX8l2fYUZVksr8R+lEHe8XLHTG3jfGiDtzbAS3EBOcA==',key_name='tempest-keypair-271008495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-oyejk6uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=94b085b2-b298-4780-be94-21f85c799945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG os_vif [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b6890b6-3ae2-5e7f-89ab-3c0875182ff7', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc60abc7f-b5, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc60abc7f-b5, col_values=(('qos', UUID('70100ade-f2c6-45c5-a170-2a22598991e7')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc60abc7f-b5, col_values=(('external_ids', {'iface-id': 'c60abc7f-b5c7-45ef-a218-d7454c7dbff8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:09:03', 'vm-uuid': '94b085b2-b298-4780-be94-21f85c799945'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:54 user nova-compute[74959]: INFO os_vif [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5')
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No VIF found with MAC fa:16:3e:39:09:03, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.neutron [req-4b3e4aab-3efa-4caa-90da-f6ac193c5492 req-664d48dd-b746-47b5-9d1e-67d85876d1fd service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updated VIF entry in instance network info cache for port cf3e934b-c8e7-4432-ae58-fe4282d0d384. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.neutron [req-4b3e4aab-3efa-4caa-90da-f6ac193c5492 req-664d48dd-b746-47b5-9d1e-67d85876d1fd service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updating instance_info_cache with network_info: [{"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4b3e4aab-3efa-4caa-90da-f6ac193c5492 req-664d48dd-b746-47b5-9d1e-67d85876d1fd service nova] Releasing lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Successfully updated port: 67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquired lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-9ecc2228-fd93-4fd8-bfc9-1b547103172f req-0c313df0-f8d6-4b02-8282-fb57602522c1 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-changed-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-9ecc2228-fd93-4fd8-bfc9-1b547103172f req-0c313df0-f8d6-4b02-8282-fb57602522c1 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Refreshing instance network info cache due to event network-changed-67663953-c88b-4b51-88e5-2904a213a0ef. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ecc2228-fd93-4fd8-bfc9-1b547103172f req-0c313df0-f8d6-4b02-8282-fb57602522c1 service nova] Acquiring lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.neutron [req-beb8db51-cbec-49f0-a92d-d79f68bdd8f9 req-0cf6d03c-7a76-4a9d-b7df-af2a0223278b service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updated VIF entry in instance network info cache for port c60abc7f-b5c7-45ef-a218-d7454c7dbff8. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.neutron [req-beb8db51-cbec-49f0-a92d-d79f68bdd8f9 req-0cf6d03c-7a76-4a9d-b7df-af2a0223278b service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-beb8db51-cbec-49f0-a92d-d79f68bdd8f9 req-0cf6d03c-7a76-4a9d-b7df-af2a0223278b service nova] Releasing lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Releasing lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance network_info: |[{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ecc2228-fd93-4fd8-bfc9-1b547103172f req-0c313df0-f8d6-4b02-8282-fb57602522c1 service nova] Acquired lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.neutron [req-9ecc2228-fd93-4fd8-bfc9-1b547103172f req-0c313df0-f8d6-4b02-8282-fb57602522c1 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Refreshing network info cache for port 67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Start _get_guest_xml network_info=[{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:58:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.objects.instance [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lazy-loading 'pci_devices' on Instance uuid 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:58:55 user nova-compute[74959]:   <uuid>7011df2d-f2c5-48ba-8d4c-d0539c235917</uuid>
Nov 28 22:58:55 user nova-compute[74959]:   <name>instance-00000004</name>
Nov 28 22:58:55 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:58:55 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:58:55 user nova-compute[74959]:   <metadata>
Nov 28 22:58:55 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:58:55 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:58:55 user nova-compute[74959]:       <nova:name>tempest-ServerActionsTestOtherB-server-1175671381</nova:name>
Nov 28 22:58:55 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:58:55</nova:creationTime>
Nov 28 22:58:55 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:58:55 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:58:55 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:58:55 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:58:55 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:58:55 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:58:55 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:58:55 user nova-compute[74959]:       <nova:owner>
Nov 28 22:58:55 user nova-compute[74959]:         <nova:user uuid="911d51b00a8e442cbe38d5e511edba81">tempest-ServerActionsTestOtherB-152667612-project-member</nova:user>
Nov 28 22:58:55 user nova-compute[74959]:         <nova:project uuid="5e566d89eec64455b5bdb1b105bfe9a0">tempest-ServerActionsTestOtherB-152667612</nova:project>
Nov 28 22:58:55 user nova-compute[74959]:       </nova:owner>
Nov 28 22:58:55 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:58:55 user nova-compute[74959]:       <nova:ports>
Nov 28 22:58:55 user nova-compute[74959]:         <nova:port uuid="67663953-c88b-4b51-88e5-2904a213a0ef">
Nov 28 22:58:55 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 22:58:55 user nova-compute[74959]:         </nova:port>
Nov 28 22:58:55 user nova-compute[74959]:       </nova:ports>
Nov 28 22:58:55 user nova-compute[74959]:     </nova:instance>
Nov 28 22:58:55 user nova-compute[74959]:   </metadata>
Nov 28 22:58:55 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:58:55 user nova-compute[74959]:     <system>
Nov 28 22:58:55 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:58:55 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:58:55 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:58:55 user nova-compute[74959]:       <entry name="serial">7011df2d-f2c5-48ba-8d4c-d0539c235917</entry>
Nov 28 22:58:55 user nova-compute[74959]:       <entry name="uuid">7011df2d-f2c5-48ba-8d4c-d0539c235917</entry>
Nov 28 22:58:55 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:58:55 user nova-compute[74959]:     </system>
Nov 28 22:58:55 user nova-compute[74959]:   </sysinfo>
Nov 28 22:58:55 user nova-compute[74959]:   <os>
Nov 28 22:58:55 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:58:55 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:58:55 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:58:55 user nova-compute[74959]:   </os>
Nov 28 22:58:55 user nova-compute[74959]:   <features>
Nov 28 22:58:55 user nova-compute[74959]:     <acpi/>
Nov 28 22:58:55 user nova-compute[74959]:     <apic/>
Nov 28 22:58:55 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:58:55 user nova-compute[74959]:   </features>
Nov 28 22:58:55 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:58:55 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:58:55 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:58:55 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:58:55 user nova-compute[74959]:   </clock>
Nov 28 22:58:55 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:58:55 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:58:55 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:58:55 user nova-compute[74959]:   </cpu>
Nov 28 22:58:55 user nova-compute[74959]:   <devices>
Nov 28 22:58:55 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:58:55 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:58:55 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk"/>
Nov 28 22:58:55 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:58:55 user nova-compute[74959]:     </disk>
Nov 28 22:58:55 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:58:55 user nova-compute[74959]:       <mac address="fa:16:3e:b4:83:ed"/>
Nov 28 22:58:55 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:55 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:58:55 user nova-compute[74959]:       <target dev="tap67663953-c8"/>
Nov 28 22:58:55 user nova-compute[74959]:     </interface>
Nov 28 22:58:55 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:58:55 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/console.log" append="off"/>
Nov 28 22:58:55 user nova-compute[74959]:     </serial>
Nov 28 22:58:55 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:58:55 user nova-compute[74959]:     <video>
Nov 28 22:58:55 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:55 user nova-compute[74959]:     </video>
Nov 28 22:58:55 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:58:55 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:58:55 user nova-compute[74959]:     </rng>
Nov 28 22:58:55 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:58:55 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:58:55 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:58:55 user nova-compute[74959]:     </memballoon>
Nov 28 22:58:55 user nova-compute[74959]:   </devices>
Nov 28 22:58:55 user nova-compute[74959]: </domain>
Nov 28 22:58:55 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG os_vif [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b275aac-4ead-5f59-b12c-ac3d1ffce5b1', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67663953-c8, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67663953-c8, col_values=(('qos', UUID('58a9cea8-7544-4006-b2c2-20c86a497ae2')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67663953-c8, col_values=(('external_ids', {'iface-id': '67663953-c88b-4b51-88e5-2904a213a0ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:83:ed', 'vm-uuid': '7011df2d-f2c5-48ba-8d4c-d0539c235917'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:55 user nova-compute[74959]: INFO os_vif [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8')
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:58:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] No VIF found with MAC fa:16:3e:b4:83:ed, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:58:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Successfully updated port: ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:58:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquired lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:58:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-b6a54932-c212-4528-86c0-020433784cdf req-a3a883f9-11d4-4a33-8faa-a45f5509f2c2 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-changed-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:58:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-b6a54932-c212-4528-86c0-020433784cdf req-a3a883f9-11d4-4a33-8faa-a45f5509f2c2 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Refreshing instance network info cache due to event network-changed-ded8a2c4-07d6-440e-9110-4c2a7b2738f2. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:58:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b6a54932-c212-4528-86c0-020433784cdf req-a3a883f9-11d4-4a33-8faa-a45f5509f2c2 service nova] Acquiring lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:58:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG nova.network.neutron [req-9ecc2228-fd93-4fd8-bfc9-1b547103172f req-0c313df0-f8d6-4b02-8282-fb57602522c1 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updated VIF entry in instance network info cache for port 67663953-c88b-4b51-88e5-2904a213a0ef. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG nova.network.neutron [req-9ecc2228-fd93-4fd8-bfc9-1b547103172f req-0c313df0-f8d6-4b02-8282-fb57602522c1 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ecc2228-fd93-4fd8-bfc9-1b547103172f req-0c313df0-f8d6-4b02-8282-fb57602522c1 service nova] Releasing lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Releasing lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance network_info: |[{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b6a54932-c212-4528-86c0-020433784cdf req-a3a883f9-11d4-4a33-8faa-a45f5509f2c2 service nova] Acquired lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG nova.network.neutron [req-b6a54932-c212-4528-86c0-020433784cdf req-a3a883f9-11d4-4a33-8faa-a45f5509f2c2 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Refreshing network info cache for port ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Start _get_guest_xml network_info=[{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-b6a54932-c212-4528-86c0-020433784cdf req-a3a883f9-11d4-4a33-8faa-a45f5509f2c2 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updated VIF entry in instance network info cache for port ded8a2c4-07d6-440e-9110-4c2a7b2738f2. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:58:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-b6a54932-c212-4528-86c0-020433784cdf req-a3a883f9-11d4-4a33-8faa-a45f5509f2c2 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:58:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b6a54932-c212-4528-86c0-020433784cdf req-a3a883f9-11d4-4a33-8faa-a45f5509f2c2 service nova] Releasing lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:58:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Instance spawned successfully.
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:58:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'pci_devices' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:58:59 user nova-compute[74959]:   <uuid>9492b249-758e-4b8f-acfb-f334ef80a9dd</uuid>
Nov 28 22:58:59 user nova-compute[74959]:   <name>instance-00000006</name>
Nov 28 22:58:59 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:58:59 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:58:59 user nova-compute[74959]:   <metadata>
Nov 28 22:58:59 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:58:59 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:58:59 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeTestJSON-server-1150032391</nova:name>
Nov 28 22:58:59 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:58:59</nova:creationTime>
Nov 28 22:58:59 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:58:59 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:58:59 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:58:59 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:58:59 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:58:59 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:58:59 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:58:59 user nova-compute[74959]:       <nova:owner>
Nov 28 22:58:59 user nova-compute[74959]:         <nova:user uuid="ba2c8fce9ab041ba928f65f59468683e">tempest-AttachVolumeTestJSON-803300239-project-member</nova:user>
Nov 28 22:58:59 user nova-compute[74959]:         <nova:project uuid="c95b70a9bba84ebc95d6d7aea0d8c649">tempest-AttachVolumeTestJSON-803300239</nova:project>
Nov 28 22:58:59 user nova-compute[74959]:       </nova:owner>
Nov 28 22:58:59 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:58:59 user nova-compute[74959]:       <nova:ports>
Nov 28 22:58:59 user nova-compute[74959]:         <nova:port uuid="ded8a2c4-07d6-440e-9110-4c2a7b2738f2">
Nov 28 22:58:59 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 22:58:59 user nova-compute[74959]:         </nova:port>
Nov 28 22:58:59 user nova-compute[74959]:       </nova:ports>
Nov 28 22:58:59 user nova-compute[74959]:     </nova:instance>
Nov 28 22:58:59 user nova-compute[74959]:   </metadata>
Nov 28 22:58:59 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:58:59 user nova-compute[74959]:     <system>
Nov 28 22:58:59 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:58:59 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:58:59 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:58:59 user nova-compute[74959]:       <entry name="serial">9492b249-758e-4b8f-acfb-f334ef80a9dd</entry>
Nov 28 22:58:59 user nova-compute[74959]:       <entry name="uuid">9492b249-758e-4b8f-acfb-f334ef80a9dd</entry>
Nov 28 22:58:59 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:58:59 user nova-compute[74959]:     </system>
Nov 28 22:58:59 user nova-compute[74959]:   </sysinfo>
Nov 28 22:58:59 user nova-compute[74959]:   <os>
Nov 28 22:58:59 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:58:59 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:58:59 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:58:59 user nova-compute[74959]:   </os>
Nov 28 22:58:59 user nova-compute[74959]:   <features>
Nov 28 22:58:59 user nova-compute[74959]:     <acpi/>
Nov 28 22:58:59 user nova-compute[74959]:     <apic/>
Nov 28 22:58:59 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:58:59 user nova-compute[74959]:   </features>
Nov 28 22:58:59 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:58:59 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:58:59 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:58:59 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:58:59 user nova-compute[74959]:   </clock>
Nov 28 22:58:59 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:58:59 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:58:59 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:58:59 user nova-compute[74959]:   </cpu>
Nov 28 22:58:59 user nova-compute[74959]:   <devices>
Nov 28 22:58:59 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:58:59 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:58:59 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk"/>
Nov 28 22:58:59 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:58:59 user nova-compute[74959]:     </disk>
Nov 28 22:58:59 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:58:59 user nova-compute[74959]:       <mac address="fa:16:3e:69:f4:ad"/>
Nov 28 22:58:59 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:59 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:58:59 user nova-compute[74959]:       <target dev="tapded8a2c4-07"/>
Nov 28 22:58:59 user nova-compute[74959]:     </interface>
Nov 28 22:58:59 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:58:59 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/console.log" append="off"/>
Nov 28 22:58:59 user nova-compute[74959]:     </serial>
Nov 28 22:58:59 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:58:59 user nova-compute[74959]:     <video>
Nov 28 22:58:59 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:58:59 user nova-compute[74959]:     </video>
Nov 28 22:58:59 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:58:59 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:58:59 user nova-compute[74959]:     </rng>
Nov 28 22:58:59 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:58:59 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:58:59 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:58:59 user nova-compute[74959]:     </memballoon>
Nov 28 22:58:59 user nova-compute[74959]:   </devices>
Nov 28 22:58:59 user nova-compute[74959]: </domain>
Nov 28 22:58:59 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG os_vif [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2570ecb9-1128-584b-a1cb-dd1ea8f8f7bb', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapded8a2c4-07, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapded8a2c4-07, col_values=(('qos', UUID('9ac414fa-f4e9-4470-a638-00f909ccc74c')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapded8a2c4-07, col_values=(('external_ids', {'iface-id': 'ded8a2c4-07d6-440e-9110-4c2a7b2738f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:f4:ad', 'vm-uuid': '9492b249-758e-4b8f-acfb-f334ef80a9dd'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:58:59 user nova-compute[74959]: INFO nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Took 17.04 seconds to spawn the instance on the hypervisor.
Nov 28 22:58:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:58:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:58:59 user nova-compute[74959]: INFO os_vif [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07')
Nov 28 22:59:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:59:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No VIF found with MAC fa:16:3e:69:f4:ad, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:59:00 user nova-compute[74959]: INFO nova.compute.manager [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Took 17.97 seconds to build instance.
Nov 28 22:59:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7a7ddb3d-1c69-469b-b1d5-a602eb109cbe tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.558s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-33fc2b78-d699-4c30-95ea-3c42173f0333 req-58671683-e6e4-471e-a28a-4378b74a01bd service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received event network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33fc2b78-d699-4c30-95ea-3c42173f0333 req-58671683-e6e4-471e-a28a-4378b74a01bd service nova] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33fc2b78-d699-4c30-95ea-3c42173f0333 req-58671683-e6e4-471e-a28a-4378b74a01bd service nova] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33fc2b78-d699-4c30-95ea-3c42173f0333 req-58671683-e6e4-471e-a28a-4378b74a01bd service nova] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-33fc2b78-d699-4c30-95ea-3c42173f0333 req-58671683-e6e4-471e-a28a-4378b74a01bd service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] No waiting events found dispatching network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:01 user nova-compute[74959]: WARNING nova.compute.manager [req-33fc2b78-d699-4c30-95ea-3c42173f0333 req-58671683-e6e4-471e-a28a-4378b74a01bd service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received unexpected event network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 for instance with vm_state building and task_state spawning.
Nov 28 22:59:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Instance spawned successfully.
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:01 user nova-compute[74959]: INFO nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Took 18.33 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:01 user nova-compute[74959]: INFO nova.compute.manager [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Took 19.40 seconds to build instance.
Nov 28 22:59:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-adc9a172-1353-47f3-803e-caa737a3d008 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.674s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:02 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Instance spawned successfully.
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:03 user nova-compute[74959]: INFO nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Took 15.13 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-bfd49c2a-9edf-4bc6-b987-aa2e5ce2b6f6 req-bc804f7c-13d7-4812-a085-982eceba7b21 service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received event network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bfd49c2a-9edf-4bc6-b987-aa2e5ce2b6f6 req-bc804f7c-13d7-4812-a085-982eceba7b21 service nova] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bfd49c2a-9edf-4bc6-b987-aa2e5ce2b6f6 req-bc804f7c-13d7-4812-a085-982eceba7b21 service nova] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bfd49c2a-9edf-4bc6-b987-aa2e5ce2b6f6 req-bc804f7c-13d7-4812-a085-982eceba7b21 service nova] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-bfd49c2a-9edf-4bc6-b987-aa2e5ce2b6f6 req-bc804f7c-13d7-4812-a085-982eceba7b21 service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] No waiting events found dispatching network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:03 user nova-compute[74959]: WARNING nova.compute.manager [req-bfd49c2a-9edf-4bc6-b987-aa2e5ce2b6f6 req-bc804f7c-13d7-4812-a085-982eceba7b21 service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received unexpected event network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 for instance with vm_state active and task_state None.
Nov 28 22:59:03 user nova-compute[74959]: INFO nova.compute.manager [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Took 16.07 seconds to build instance.
Nov 28 22:59:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-315417bf-3b94-41c0-90db-f810dad2f2e8 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.287s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance spawned successfully.
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance spawned successfully.
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:05 user nova-compute[74959]: INFO nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Took 15.77 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:05 user nova-compute[74959]: INFO nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Took 15.12 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:05 user nova-compute[74959]: INFO nova.compute.manager [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Took 17.06 seconds to build instance.
Nov 28 22:59:05 user nova-compute[74959]: INFO nova.compute.manager [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Took 17.08 seconds to build instance.
Nov 28 22:59:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a99ab499-a6dd-404a-adc2-0527aa673bba tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.221s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9063974c-c7c0-4ca8-9a12-43ac59b2fd80 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.245s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance spawned successfully.
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:06 user nova-compute[74959]: INFO nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Took 15.51 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:06 user nova-compute[74959]: INFO nova.compute.manager [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Took 16.85 seconds to build instance.
Nov 28 22:59:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b22437db-5e83-4c6b-b464-d5b3a7249b9e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.248s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:59:07 user nova-compute[74959]: INFO nova.compute.claims [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Claim successful on node user
Nov 28 22:59:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.network.neutron [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:59:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.policy [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b801c03a17a54b2dbb2d7d7e1a708126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ef9d9fe9334bb19ddccc256847afcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:59:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Creating image(s)
Nov 28 22:59:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "/opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "/opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "/opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.390s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.276s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk 1073741824" returned: 0 in 0.072s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.274s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.397s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Cannot resize image /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Ensure instance console log exists: /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Successfully created port: 62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:59:11 user nova-compute[74959]: INFO nova.compute.claims [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Claim successful on node user
Nov 28 22:59:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.895s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.165s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:59:11 user nova-compute[74959]: INFO nova.compute.claims [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Claim successful on node user
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:59:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Successfully updated port: 62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquired lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.policy [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0454c25fc7a643f39d57bf47c178c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe553fd34cd94f2b9b1df89edb8a75af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:59:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Creating image(s)
Nov 28 22:59:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "/opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "/opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "/opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "47c128d3aafd2b63ecffd82391d1a6bf0036fae7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "47c128d3aafd2b63ecffd82391d1a6bf0036fae7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-adebf1d0-25a2-4a79-b940-d07553220679 req-fa0f492e-f27b-46b6-aae5-0546f8057447 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received event network-changed-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-adebf1d0-25a2-4a79-b940-d07553220679 req-fa0f492e-f27b-46b6-aae5-0546f8057447 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Refreshing instance network info cache due to event network-changed-62a02076-f272-41c6-aa3a-f49c904dfa68. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-adebf1d0-25a2-4a79-b940-d07553220679 req-fa0f492e-f27b-46b6-aae5-0546f8057447 service nova] Acquiring lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Updating instance_info_cache with network_info: [{"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Releasing lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Instance network_info: |[{"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-adebf1d0-25a2-4a79-b940-d07553220679 req-fa0f492e-f27b-46b6-aae5-0546f8057447 service nova] Acquired lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-adebf1d0-25a2-4a79-b940-d07553220679 req-fa0f492e-f27b-46b6-aae5-0546f8057447 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Refreshing network info cache for port 62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Start _get_guest_xml network_info=[{"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:59:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7.part --force-share --output=json" returned: 0 in 0.369s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.images [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] b4934419-54c6-47bc-8402-8145f283d1f8 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7.part /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.673s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1357588568',display_name='tempest-VolumesAdminNegativeTest-server-1357588568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1357588568',id=7,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFe4mgQ8aGd7KKF0BVgVScxJwhOUwBkKbQcRp3MP91XXKmZt0h9WklD1o5VUgQZbBBUWQCB+VOGq0FcpWI/nby/M47xclpEjJAEuRZXEn8l671LoBKR1pNoAvw8M82PUQ==',key_name='tempest-keypair-1068431521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ef9d9fe9334bb19ddccc256847afcc',ramdisk_id='',reservation_id='r-ukpvxxj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1277404831',owner_user_name='tempest-VolumesAdminNegativeTest-1277404831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b801c03a17a54b2dbb2d7d7e1a708126',uuid=d339c51b-2c03-4ac9-800f-b5dc053e0585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converting VIF {"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:86:26,bridge_name='br-int',has_traffic_filtering=True,id=62a02076-f272-41c6-aa3a-f49c904dfa68,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a02076-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.objects.instance [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lazy-loading 'pci_devices' on Instance uuid d339c51b-2c03-4ac9-800f-b5dc053e0585 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7.part /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7.converted" returned: 0 in 0.345s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:59:13 user nova-compute[74959]:   <uuid>d339c51b-2c03-4ac9-800f-b5dc053e0585</uuid>
Nov 28 22:59:13 user nova-compute[74959]:   <name>instance-00000007</name>
Nov 28 22:59:13 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:59:13 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:59:13 user nova-compute[74959]:   <metadata>
Nov 28 22:59:13 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:59:13 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:59:13 user nova-compute[74959]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1357588568</nova:name>
Nov 28 22:59:13 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:59:13</nova:creationTime>
Nov 28 22:59:13 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:59:13 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:59:13 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:59:13 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:59:13 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:59:13 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:59:13 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:59:13 user nova-compute[74959]:       <nova:owner>
Nov 28 22:59:13 user nova-compute[74959]:         <nova:user uuid="b801c03a17a54b2dbb2d7d7e1a708126">tempest-VolumesAdminNegativeTest-1277404831-project-member</nova:user>
Nov 28 22:59:13 user nova-compute[74959]:         <nova:project uuid="29ef9d9fe9334bb19ddccc256847afcc">tempest-VolumesAdminNegativeTest-1277404831</nova:project>
Nov 28 22:59:13 user nova-compute[74959]:       </nova:owner>
Nov 28 22:59:13 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:59:13 user nova-compute[74959]:       <nova:ports>
Nov 28 22:59:13 user nova-compute[74959]:         <nova:port uuid="62a02076-f272-41c6-aa3a-f49c904dfa68">
Nov 28 22:59:13 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 22:59:13 user nova-compute[74959]:         </nova:port>
Nov 28 22:59:13 user nova-compute[74959]:       </nova:ports>
Nov 28 22:59:13 user nova-compute[74959]:     </nova:instance>
Nov 28 22:59:13 user nova-compute[74959]:   </metadata>
Nov 28 22:59:13 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:59:13 user nova-compute[74959]:     <system>
Nov 28 22:59:13 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:59:13 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:59:13 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:59:13 user nova-compute[74959]:       <entry name="serial">d339c51b-2c03-4ac9-800f-b5dc053e0585</entry>
Nov 28 22:59:13 user nova-compute[74959]:       <entry name="uuid">d339c51b-2c03-4ac9-800f-b5dc053e0585</entry>
Nov 28 22:59:13 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:59:13 user nova-compute[74959]:     </system>
Nov 28 22:59:13 user nova-compute[74959]:   </sysinfo>
Nov 28 22:59:13 user nova-compute[74959]:   <os>
Nov 28 22:59:13 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:59:13 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:59:13 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:59:13 user nova-compute[74959]:   </os>
Nov 28 22:59:13 user nova-compute[74959]:   <features>
Nov 28 22:59:13 user nova-compute[74959]:     <acpi/>
Nov 28 22:59:13 user nova-compute[74959]:     <apic/>
Nov 28 22:59:13 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:59:13 user nova-compute[74959]:   </features>
Nov 28 22:59:13 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:59:13 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:59:13 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:59:13 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:59:13 user nova-compute[74959]:   </clock>
Nov 28 22:59:13 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:59:13 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:59:13 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:59:13 user nova-compute[74959]:   </cpu>
Nov 28 22:59:13 user nova-compute[74959]:   <devices>
Nov 28 22:59:13 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:59:13 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:59:13 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk"/>
Nov 28 22:59:13 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:59:13 user nova-compute[74959]:     </disk>
Nov 28 22:59:13 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:59:13 user nova-compute[74959]:       <mac address="fa:16:3e:d6:86:26"/>
Nov 28 22:59:13 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:13 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:59:13 user nova-compute[74959]:       <target dev="tap62a02076-f2"/>
Nov 28 22:59:13 user nova-compute[74959]:     </interface>
Nov 28 22:59:13 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:59:13 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/console.log" append="off"/>
Nov 28 22:59:13 user nova-compute[74959]:     </serial>
Nov 28 22:59:13 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:59:13 user nova-compute[74959]:     <video>
Nov 28 22:59:13 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:13 user nova-compute[74959]:     </video>
Nov 28 22:59:13 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:59:13 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:59:13 user nova-compute[74959]:     </rng>
Nov 28 22:59:13 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:59:13 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:59:13 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:59:13 user nova-compute[74959]:     </memballoon>
Nov 28 22:59:13 user nova-compute[74959]:   </devices>
Nov 28 22:59:13 user nova-compute[74959]: </domain>
Nov 28 22:59:13 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1357588568',display_name='tempest-VolumesAdminNegativeTest-server-1357588568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1357588568',id=7,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFe4mgQ8aGd7KKF0BVgVScxJwhOUwBkKbQcRp3MP91XXKmZt0h9WklD1o5VUgQZbBBUWQCB+VOGq0FcpWI/nby/M47xclpEjJAEuRZXEn8l671LoBKR1pNoAvw8M82PUQ==',key_name='tempest-keypair-1068431521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ef9d9fe9334bb19ddccc256847afcc',ramdisk_id='',reservation_id='r-ukpvxxj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1277404831',owner_user_name='tempest-VolumesAdminNegativeTest-1277404831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b801c03a17a54b2dbb2d7d7e1a708126',uuid=d339c51b-2c03-4ac9-800f-b5dc053e0585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converting VIF {"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:86:26,bridge_name='br-int',has_traffic_filtering=True,id=62a02076-f272-41c6-aa3a-f49c904dfa68,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a02076-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG os_vif [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:86:26,bridge_name='br-int',has_traffic_filtering=True,id=62a02076-f272-41c6-aa3a-f49c904dfa68,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a02076-f2') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:59:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c949fec3-9e7a-5074-8037-7aafdefdd0ba', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Successfully created port: 2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62a02076-f2, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62a02076-f2, col_values=(('qos', UUID('71c6d03a-2400-4bff-bbd3-eb583b591c2c')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62a02076-f2, col_values=(('external_ids', {'iface-id': '62a02076-f272-41c6-aa3a-f49c904dfa68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:86:26', 'vm-uuid': 'd339c51b-2c03-4ac9-800f-b5dc053e0585'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:14 user nova-compute[74959]: INFO os_vif [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:86:26,bridge_name='br-int',has_traffic_filtering=True,id=62a02076-f272-41c6-aa3a-f49c904dfa68,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a02076-f2')
Nov 28 22:59:14 user nova-compute[74959]: DEBUG nova.policy [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ee17e5f07f04b31b55b3fa94c8cf8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c3efd63364440eb53df04de34a01bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] No VIF found with MAC fa:16:3e:d6:86:26, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7.converted --force-share --output=json" returned: 0 in 0.511s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "47c128d3aafd2b63ecffd82391d1a6bf0036fae7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.989s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:59:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Creating image(s)
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7 --force-share --output=json" returned: 0 in 0.365s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "47c128d3aafd2b63ecffd82391d1a6bf0036fae7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "47c128d3aafd2b63ecffd82391d1a6bf0036fae7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.299s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7 --force-share --output=json" returned: 0 in 0.354s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7,backing_fmt=raw /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.412s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7,backing_fmt=raw /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk 1073741824" returned: 0 in 0.227s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "47c128d3aafd2b63ecffd82391d1a6bf0036fae7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.589s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk 1073741824" returned: 0 in 0.205s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.622s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG nova.network.neutron [req-adebf1d0-25a2-4a79-b940-d07553220679 req-fa0f492e-f27b-46b6-aae5-0546f8057447 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Updated VIF entry in instance network info cache for port 62a02076-f272-41c6-aa3a-f49c904dfa68. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG nova.network.neutron [req-adebf1d0-25a2-4a79-b940-d07553220679 req-fa0f492e-f27b-46b6-aae5-0546f8057447 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Updating instance_info_cache with network_info: [{"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-adebf1d0-25a2-4a79-b940-d07553220679 req-fa0f492e-f27b-46b6-aae5-0546f8057447 service nova] Releasing lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Successfully created port: c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.269s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7 --force-share --output=json" returned: 0 in 0.461s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-dbbb5deb-d994-4aa1-b34b-90ecf23d470f req-0bddca57-1dcd-4077-80b6-69f8f1fcb4ef service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-dbbb5deb-d994-4aa1-b34b-90ecf23d470f req-0bddca57-1dcd-4077-80b6-69f8f1fcb4ef service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-dbbb5deb-d994-4aa1-b34b-90ecf23d470f req-0bddca57-1dcd-4077-80b6-69f8f1fcb4ef service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-dbbb5deb-d994-4aa1-b34b-90ecf23d470f req-0bddca57-1dcd-4077-80b6-69f8f1fcb4ef service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-dbbb5deb-d994-4aa1-b34b-90ecf23d470f req-0bddca57-1dcd-4077-80b6-69f8f1fcb4ef service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:16 user nova-compute[74959]: WARNING nova.compute.manager [req-dbbb5deb-d994-4aa1-b34b-90ecf23d470f req-0bddca57-1dcd-4077-80b6-69f8f1fcb4ef service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state active and task_state None.
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json" returned: 0 in 0.661s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Cannot resize image /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Ensure instance console log exists: /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json" returned: 0 in 0.707s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Cannot resize image /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Ensure instance console log exists: /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.015s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:59:16 user nova-compute[74959]: INFO nova.compute.claims [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Claim successful on node user
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.network.neutron [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Successfully updated port: 2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquired lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.network.neutron [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-c36b475d-9e54-45d8-87cc-6f6ac291a553 req-fe946cf2-8a9a-47d1-a822-21d2bbc2f7d7 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received event network-changed-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-c36b475d-9e54-45d8-87cc-6f6ac291a553 req-fe946cf2-8a9a-47d1-a822-21d2bbc2f7d7 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Refreshing instance network info cache due to event network-changed-2b663438-3f9d-4bbf-aabf-e321f898662d. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c36b475d-9e54-45d8-87cc-6f6ac291a553 req-fe946cf2-8a9a-47d1-a822-21d2bbc2f7d7 service nova] Acquiring lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.network.neutron [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.859s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.network.neutron [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Updating instance_info_cache with network_info: [{"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Releasing lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Instance network_info: |[{"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c36b475d-9e54-45d8-87cc-6f6ac291a553 req-fe946cf2-8a9a-47d1-a822-21d2bbc2f7d7 service nova] Acquired lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.network.neutron [req-c36b475d-9e54-45d8-87cc-6f6ac291a553 req-fe946cf2-8a9a-47d1-a822-21d2bbc2f7d7 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Refreshing network info cache for port 2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Start _get_guest_xml network_info=[{"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:59:00Z,direct_url=<?>,disk_format='qcow2',id=b4934419-54c6-47bc-8402-8145f283d1f8,min_disk=0,min_ram=0,name='',owner='7dd3913a524744128c69460a4caa5dbd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:59:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'b4934419-54c6-47bc-8402-8145f283d1f8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:59:17 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:17 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:59:00Z,direct_url=<?>,disk_format='qcow2',id=b4934419-54c6-47bc-8402-8145f283d1f8,min_disk=0,min_ram=0,name='',owner='7dd3913a524744128c69460a4caa5dbd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:59:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-7130657',display_name='tempest-AttachSCSIVolumeTestJSON-server-7130657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-7130657',id=8,image_ref='b4934419-54c6-47bc-8402-8145f283d1f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6xT2ZvE/cUZ0LEetkP3rD6pidYf6WyPgqDUtJuUaC8L2QTQh5I6kVw2z86NLmL/7OQvdC2Rz7/zd1wJOGxp9YhE/s31YFW9cfnZj/JYu9XWPbntKxxkyWh3dPo47VaGg==',key_name='tempest-keypair-744859541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe553fd34cd94f2b9b1df89edb8a75af',ramdisk_id='',reservation_id='r-8kz4w0oy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4934419-54c6-47bc-8402-8145f283d1f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1085168283',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1085168283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0454c25fc7a643f39d57bf47c178c19b',uuid=17495411-b15b-4660-b2fe-42749b11ed49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Converting VIF {"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ab:da,bridge_name='br-int',has_traffic_filtering=True,id=2b663438-3f9d-4bbf-aabf-e321f898662d,network=Network(92c963b3-4071-4ffa-a1ae-724968bfb820),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b663438-3f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lazy-loading 'pci_devices' on Instance uuid 17495411-b15b-4660-b2fe-42749b11ed49 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.network.neutron [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:59:17 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:59:17 user nova-compute[74959]:   <uuid>17495411-b15b-4660-b2fe-42749b11ed49</uuid>
Nov 28 22:59:17 user nova-compute[74959]:   <name>instance-00000008</name>
Nov 28 22:59:17 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:59:17 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:59:17 user nova-compute[74959]:   <metadata>
Nov 28 22:59:17 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:59:17 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:59:17 user nova-compute[74959]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-7130657</nova:name>
Nov 28 22:59:17 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:59:17</nova:creationTime>
Nov 28 22:59:17 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:59:17 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:59:17 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:59:17 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:59:17 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:59:17 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:59:17 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:59:17 user nova-compute[74959]:       <nova:owner>
Nov 28 22:59:17 user nova-compute[74959]:         <nova:user uuid="0454c25fc7a643f39d57bf47c178c19b">tempest-AttachSCSIVolumeTestJSON-1085168283-project-member</nova:user>
Nov 28 22:59:17 user nova-compute[74959]:         <nova:project uuid="fe553fd34cd94f2b9b1df89edb8a75af">tempest-AttachSCSIVolumeTestJSON-1085168283</nova:project>
Nov 28 22:59:17 user nova-compute[74959]:       </nova:owner>
Nov 28 22:59:17 user nova-compute[74959]:       <nova:root type="image" uuid="b4934419-54c6-47bc-8402-8145f283d1f8"/>
Nov 28 22:59:17 user nova-compute[74959]:       <nova:ports>
Nov 28 22:59:17 user nova-compute[74959]:         <nova:port uuid="2b663438-3f9d-4bbf-aabf-e321f898662d">
Nov 28 22:59:17 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 22:59:17 user nova-compute[74959]:         </nova:port>
Nov 28 22:59:17 user nova-compute[74959]:       </nova:ports>
Nov 28 22:59:17 user nova-compute[74959]:     </nova:instance>
Nov 28 22:59:17 user nova-compute[74959]:   </metadata>
Nov 28 22:59:17 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:59:17 user nova-compute[74959]:     <system>
Nov 28 22:59:17 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:59:17 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:59:17 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:59:17 user nova-compute[74959]:       <entry name="serial">17495411-b15b-4660-b2fe-42749b11ed49</entry>
Nov 28 22:59:17 user nova-compute[74959]:       <entry name="uuid">17495411-b15b-4660-b2fe-42749b11ed49</entry>
Nov 28 22:59:17 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:59:17 user nova-compute[74959]:     </system>
Nov 28 22:59:17 user nova-compute[74959]:   </sysinfo>
Nov 28 22:59:17 user nova-compute[74959]:   <os>
Nov 28 22:59:17 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:59:17 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:59:17 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:59:17 user nova-compute[74959]:   </os>
Nov 28 22:59:17 user nova-compute[74959]:   <features>
Nov 28 22:59:17 user nova-compute[74959]:     <acpi/>
Nov 28 22:59:17 user nova-compute[74959]:     <apic/>
Nov 28 22:59:17 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:59:17 user nova-compute[74959]:   </features>
Nov 28 22:59:17 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:59:17 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:59:17 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:59:17 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:59:17 user nova-compute[74959]:   </clock>
Nov 28 22:59:17 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:59:17 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:59:17 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:59:17 user nova-compute[74959]:   </cpu>
Nov 28 22:59:17 user nova-compute[74959]:   <devices>
Nov 28 22:59:17 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:59:17 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:59:17 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk"/>
Nov 28 22:59:17 user nova-compute[74959]:       <target dev="sda" bus="scsi"/>
Nov 28 22:59:17 user nova-compute[74959]:       <address type="drive" controller="0" unit="0"/>
Nov 28 22:59:17 user nova-compute[74959]:     </disk>
Nov 28 22:59:17 user nova-compute[74959]:     <disk type="file" device="cdrom">
Nov 28 22:59:17 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 22:59:17 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk.config"/>
Nov 28 22:59:17 user nova-compute[74959]:       <target dev="sdb" bus="scsi"/>
Nov 28 22:59:17 user nova-compute[74959]:       <address type="drive" controller="0" unit="1"/>
Nov 28 22:59:17 user nova-compute[74959]:     </disk>
Nov 28 22:59:17 user nova-compute[74959]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 22:59:17 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:59:17 user nova-compute[74959]:       <mac address="fa:16:3e:ec:ab:da"/>
Nov 28 22:59:17 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:17 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:59:17 user nova-compute[74959]:       <target dev="tap2b663438-3f"/>
Nov 28 22:59:17 user nova-compute[74959]:     </interface>
Nov 28 22:59:17 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:59:17 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/console.log" append="off"/>
Nov 28 22:59:17 user nova-compute[74959]:     </serial>
Nov 28 22:59:17 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:59:17 user nova-compute[74959]:     <video>
Nov 28 22:59:17 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:17 user nova-compute[74959]:     </video>
Nov 28 22:59:17 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:59:17 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:59:17 user nova-compute[74959]:     </rng>
Nov 28 22:59:17 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:59:17 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:59:17 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:59:17 user nova-compute[74959]:     </memballoon>
Nov 28 22:59:17 user nova-compute[74959]:   </devices>
Nov 28 22:59:17 user nova-compute[74959]: </domain>
Nov 28 22:59:17 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-7130657',display_name='tempest-AttachSCSIVolumeTestJSON-server-7130657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-7130657',id=8,image_ref='b4934419-54c6-47bc-8402-8145f283d1f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6xT2ZvE/cUZ0LEetkP3rD6pidYf6WyPgqDUtJuUaC8L2QTQh5I6kVw2z86NLmL/7OQvdC2Rz7/zd1wJOGxp9YhE/s31YFW9cfnZj/JYu9XWPbntKxxkyWh3dPo47VaGg==',key_name='tempest-keypair-744859541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe553fd34cd94f2b9b1df89edb8a75af',ramdisk_id='',reservation_id='r-8kz4w0oy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4934419-54c6-47bc-8402-8145f283d1f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1085168283',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1085168283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0454c25fc7a643f39d57bf47c178c19b',uuid=17495411-b15b-4660-b2fe-42749b11ed49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Converting VIF {"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ab:da,bridge_name='br-int',has_traffic_filtering=True,id=2b663438-3f9d-4bbf-aabf-e321f898662d,network=Network(92c963b3-4071-4ffa-a1ae-724968bfb820),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b663438-3f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG os_vif [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ab:da,bridge_name='br-int',has_traffic_filtering=True,id=2b663438-3f9d-4bbf-aabf-e321f898662d,network=Network(92c963b3-4071-4ffa-a1ae-724968bfb820),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b663438-3f') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26bd602f-d500-5881-906d-d38c4562d94d', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b663438-3f, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b663438-3f, col_values=(('qos', UUID('8a2a51b5-a024-4f0f-8593-db2e6e88a62c')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b663438-3f, col_values=(('external_ids', {'iface-id': '2b663438-3f9d-4bbf-aabf-e321f898662d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:ab:da', 'vm-uuid': '17495411-b15b-4660-b2fe-42749b11ed49'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:59:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:17 user nova-compute[74959]: INFO os_vif [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:ab:da,bridge_name='br-int',has_traffic_filtering=True,id=2b663438-3f9d-4bbf-aabf-e321f898662d,network=Network(92c963b3-4071-4ffa-a1ae-724968bfb820),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b663438-3f')
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.policy [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55566c37576a40198a8589b801efc04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf04da378904e228154c55fcbd6447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] No BDM found with device name sda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] No VIF found with MAC fa:16:3e:ec:ab:da, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:59:18 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Using config drive
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Successfully updated port: c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-4650fb30-0733-4f0d-a055-0ae673c27743 req-9cebabba-3b2d-4bd8-b5ed-4fbdc55fdc99 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4650fb30-0733-4f0d-a055-0ae673c27743 req-9cebabba-3b2d-4bd8-b5ed-4fbdc55fdc99 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4650fb30-0733-4f0d-a055-0ae673c27743 req-9cebabba-3b2d-4bd8-b5ed-4fbdc55fdc99 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4650fb30-0733-4f0d-a055-0ae673c27743 req-9cebabba-3b2d-4bd8-b5ed-4fbdc55fdc99 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-4650fb30-0733-4f0d-a055-0ae673c27743 req-9cebabba-3b2d-4bd8-b5ed-4fbdc55fdc99 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:18 user nova-compute[74959]: WARNING nova.compute.manager [req-4650fb30-0733-4f0d-a055-0ae673c27743 req-9cebabba-3b2d-4bd8-b5ed-4fbdc55fdc99 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state active and task_state None.
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:59:18 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Creating image(s)
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "/opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "/opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquired lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-c36b475d-9e54-45d8-87cc-6f6ac291a553 req-fe946cf2-8a9a-47d1-a822-21d2bbc2f7d7 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Updated VIF entry in instance network info cache for port 2b663438-3f9d-4bbf-aabf-e321f898662d. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-c36b475d-9e54-45d8-87cc-6f6ac291a553 req-fe946cf2-8a9a-47d1-a822-21d2bbc2f7d7 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Updating instance_info_cache with network_info: [{"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c36b475d-9e54-45d8-87cc-6f6ac291a553 req-fe946cf2-8a9a-47d1-a822-21d2bbc2f7d7 service nova] Releasing lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.253s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:18 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Creating config drive at /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk.config
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpagmzele5 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk 1073741824" returned: 0 in 0.228s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpagmzele5" returned: 0 in 0.133s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.500s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:18 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Instance spawned successfully.
Nov 28 22:59:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.228s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.network.neutron [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Successfully created port: 298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:19 user nova-compute[74959]: INFO nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Took 10.26 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Releasing lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Instance network_info: |[{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Start _get_guest_xml network_info=[{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:59:19 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:19 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converting VIF {"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=c3f3885d-8bb2-465b-a52f-b9ee64375c47,network=Network(77b93d0e-626f-4d47-aa84-d522c489abe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f3885d-8b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.objects.instance [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.444s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Cannot resize image /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Ensure instance console log exists: /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:19 user nova-compute[74959]: INFO nova.compute.manager [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Took 12.06 seconds to build instance.
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:59:19 user nova-compute[74959]:   <uuid>6c504232-f516-4764-8df1-7bff0a3bd413</uuid>
Nov 28 22:59:19 user nova-compute[74959]:   <name>instance-00000009</name>
Nov 28 22:59:19 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:59:19 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:59:19 user nova-compute[74959]:   <metadata>
Nov 28 22:59:19 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:59:19 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:59:19 user nova-compute[74959]:       <nova:name>tempest-device-tagging-server-536022995</nova:name>
Nov 28 22:59:19 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:59:19</nova:creationTime>
Nov 28 22:59:19 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:59:19 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:59:19 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:59:19 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:59:19 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:59:19 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:59:19 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:59:19 user nova-compute[74959]:       <nova:owner>
Nov 28 22:59:19 user nova-compute[74959]:         <nova:user uuid="1ee17e5f07f04b31b55b3fa94c8cf8a5">tempest-TaggedAttachmentsTest-1971458541-project-member</nova:user>
Nov 28 22:59:19 user nova-compute[74959]:         <nova:project uuid="01c3efd63364440eb53df04de34a01bc">tempest-TaggedAttachmentsTest-1971458541</nova:project>
Nov 28 22:59:19 user nova-compute[74959]:       </nova:owner>
Nov 28 22:59:19 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:59:19 user nova-compute[74959]:       <nova:ports>
Nov 28 22:59:19 user nova-compute[74959]:         <nova:port uuid="c3f3885d-8bb2-465b-a52f-b9ee64375c47">
Nov 28 22:59:19 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 22:59:19 user nova-compute[74959]:         </nova:port>
Nov 28 22:59:19 user nova-compute[74959]:       </nova:ports>
Nov 28 22:59:19 user nova-compute[74959]:     </nova:instance>
Nov 28 22:59:19 user nova-compute[74959]:   </metadata>
Nov 28 22:59:19 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:59:19 user nova-compute[74959]:     <system>
Nov 28 22:59:19 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:59:19 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:59:19 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:59:19 user nova-compute[74959]:       <entry name="serial">6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 22:59:19 user nova-compute[74959]:       <entry name="uuid">6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 22:59:19 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:59:19 user nova-compute[74959]:     </system>
Nov 28 22:59:19 user nova-compute[74959]:   </sysinfo>
Nov 28 22:59:19 user nova-compute[74959]:   <os>
Nov 28 22:59:19 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:59:19 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:59:19 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:59:19 user nova-compute[74959]:   </os>
Nov 28 22:59:19 user nova-compute[74959]:   <features>
Nov 28 22:59:19 user nova-compute[74959]:     <acpi/>
Nov 28 22:59:19 user nova-compute[74959]:     <apic/>
Nov 28 22:59:19 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:59:19 user nova-compute[74959]:   </features>
Nov 28 22:59:19 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:59:19 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:59:19 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:59:19 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:59:19 user nova-compute[74959]:   </clock>
Nov 28 22:59:19 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:59:19 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:59:19 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:59:19 user nova-compute[74959]:   </cpu>
Nov 28 22:59:19 user nova-compute[74959]:   <devices>
Nov 28 22:59:19 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:59:19 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:59:19 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk"/>
Nov 28 22:59:19 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:59:19 user nova-compute[74959]:     </disk>
Nov 28 22:59:19 user nova-compute[74959]:     <disk type="file" device="cdrom">
Nov 28 22:59:19 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 22:59:19 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.config"/>
Nov 28 22:59:19 user nova-compute[74959]:       <target dev="hda" bus="ide"/>
Nov 28 22:59:19 user nova-compute[74959]:     </disk>
Nov 28 22:59:19 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:59:19 user nova-compute[74959]:       <mac address="fa:16:3e:84:4e:67"/>
Nov 28 22:59:19 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:19 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:59:19 user nova-compute[74959]:       <target dev="tapc3f3885d-8b"/>
Nov 28 22:59:19 user nova-compute[74959]:     </interface>
Nov 28 22:59:19 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:59:19 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log" append="off"/>
Nov 28 22:59:19 user nova-compute[74959]:     </serial>
Nov 28 22:59:19 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:59:19 user nova-compute[74959]:     <video>
Nov 28 22:59:19 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:19 user nova-compute[74959]:     </video>
Nov 28 22:59:19 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:59:19 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:59:19 user nova-compute[74959]:     </rng>
Nov 28 22:59:19 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:59:19 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:59:19 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:59:19 user nova-compute[74959]:     </memballoon>
Nov 28 22:59:19 user nova-compute[74959]:   </devices>
Nov 28 22:59:19 user nova-compute[74959]: </domain>
Nov 28 22:59:19 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converting VIF {"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=c3f3885d-8bb2-465b-a52f-b9ee64375c47,network=Network(77b93d0e-626f-4d47-aa84-d522c489abe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f3885d-8b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG os_vif [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=c3f3885d-8bb2-465b-a52f-b9ee64375c47,network=Network(77b93d0e-626f-4d47-aa84-d522c489abe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f3885d-8b') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64bdf9c0-cd5d-5dc9-bf15-65bf805e2ab7', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3f3885d-8b, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3f3885d-8b, col_values=(('qos', UUID('9364e006-93ba-4406-bee2-996ab5a82abc')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3f3885d-8b, col_values=(('external_ids', {'iface-id': 'c3f3885d-8bb2-465b-a52f-b9ee64375c47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:4e:67', 'vm-uuid': '6c504232-f516-4764-8df1-7bff0a3bd413'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:19 user nova-compute[74959]: INFO os_vif [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=c3f3885d-8bb2-465b-a52f-b9ee64375c47,network=Network(77b93d0e-626f-4d47-aa84-d522c489abe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f3885d-8b')
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-632c3c46-c717-47af-b072-7135464fd7ad tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.473s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No BDM found with device name hda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:59:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No VIF found with MAC fa:16:3e:84:4e:67, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:59:19 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Using config drive
Nov 28 22:59:19 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Creating config drive at /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.config
Nov 28 22:59:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpycwc5hr3 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpycwc5hr3" returned: 0 in 0.085s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received event network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] No waiting events found dispatching network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:20 user nova-compute[74959]: WARNING nova.compute.manager [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received unexpected event network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 for instance with vm_state active and task_state None.
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-changed-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Refreshing instance network info cache due to event network-changed-c3f3885d-8bb2-465b-a52f-b9ee64375c47. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Acquiring lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Acquired lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.network.neutron [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Refreshing network info cache for port c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.network.neutron [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Successfully updated port: 298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquired lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.network.neutron [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-b9725f2a-4b43-49e8-8337-e72378ba6e08 req-bd1d3187-4bb7-4400-b744-0083c901322f service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received event network-changed-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-b9725f2a-4b43-49e8-8337-e72378ba6e08 req-bd1d3187-4bb7-4400-b744-0083c901322f service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Refreshing instance network info cache due to event network-changed-298ec03c-3fde-4afb-a05e-fff5d0b2af54. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b9725f2a-4b43-49e8-8337-e72378ba6e08 req-bd1d3187-4bb7-4400-b744-0083c901322f service nova] Acquiring lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.network.neutron [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.network.neutron [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Updating instance_info_cache with network_info: [{"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Releasing lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Instance network_info: |[{"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b9725f2a-4b43-49e8-8337-e72378ba6e08 req-bd1d3187-4bb7-4400-b744-0083c901322f service nova] Acquired lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.network.neutron [req-b9725f2a-4b43-49e8-8337-e72378ba6e08 req-bd1d3187-4bb7-4400-b744-0083c901322f service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Refreshing network info cache for port 298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Start _get_guest_xml network_info=[{"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:59:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.network.neutron [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updated VIF entry in instance network info cache for port c3f3885d-8bb2-465b-a52f-b9ee64375c47. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.network.neutron [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Releasing lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received event network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] No waiting events found dispatching network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:20 user nova-compute[74959]: WARNING nova.compute.manager [req-ebccd317-cda4-46a5-9a09-1a7ef55b95b0 req-7b6a3e39-7e5d-4da7-b9de-85cdcbb5d052 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received unexpected event network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 for instance with vm_state active and task_state None.
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:59:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2073362192',display_name='tempest-TestVolumeSwap-server-2073362192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2073362192',id=10,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr4hqwyEHqYoVQNT+MJNmmA6EKKdefBhWXvleHaZgLmwamfNJU1wuLK4IhL4LPK4AmeaKhwsSuw1ZV4+Ujgevxt4f43D2QTgMGBVSSK5CH4YeKcHc9kYj8cJFDRdFO+JQ==',key_name='tempest-keypair-464840639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cf04da378904e228154c55fcbd6447b',ramdisk_id='',reservation_id='r-6it2kxel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2071277782',owner_user_name='tempest-TestVolumeSwap-2071277782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55566c37576a40198a8589b801efc04e',uuid=ab7dbb0e-6b7e-4250-b0b9-23307c335494,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Converting VIF {"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:44:5b,bridge_name='br-int',has_traffic_filtering=True,id=298ec03c-3fde-4afb-a05e-fff5d0b2af54,network=Network(e69e37f5-b4e8-4c17-b4fc-99425486596b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ec03c-3f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.objects.instance [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lazy-loading 'pci_devices' on Instance uuid ab7dbb0e-6b7e-4250-b0b9-23307c335494 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:59:21 user nova-compute[74959]:   <uuid>ab7dbb0e-6b7e-4250-b0b9-23307c335494</uuid>
Nov 28 22:59:21 user nova-compute[74959]:   <name>instance-0000000a</name>
Nov 28 22:59:21 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:59:21 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:59:21 user nova-compute[74959]:   <metadata>
Nov 28 22:59:21 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:59:21 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:59:21 user nova-compute[74959]:       <nova:name>tempest-TestVolumeSwap-server-2073362192</nova:name>
Nov 28 22:59:21 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:59:20</nova:creationTime>
Nov 28 22:59:21 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:59:21 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:59:21 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:59:21 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:59:21 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:59:21 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:59:21 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:59:21 user nova-compute[74959]:       <nova:owner>
Nov 28 22:59:21 user nova-compute[74959]:         <nova:user uuid="55566c37576a40198a8589b801efc04e">tempest-TestVolumeSwap-2071277782-project-member</nova:user>
Nov 28 22:59:21 user nova-compute[74959]:         <nova:project uuid="2cf04da378904e228154c55fcbd6447b">tempest-TestVolumeSwap-2071277782</nova:project>
Nov 28 22:59:21 user nova-compute[74959]:       </nova:owner>
Nov 28 22:59:21 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:59:21 user nova-compute[74959]:       <nova:ports>
Nov 28 22:59:21 user nova-compute[74959]:         <nova:port uuid="298ec03c-3fde-4afb-a05e-fff5d0b2af54">
Nov 28 22:59:21 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 22:59:21 user nova-compute[74959]:         </nova:port>
Nov 28 22:59:21 user nova-compute[74959]:       </nova:ports>
Nov 28 22:59:21 user nova-compute[74959]:     </nova:instance>
Nov 28 22:59:21 user nova-compute[74959]:   </metadata>
Nov 28 22:59:21 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:59:21 user nova-compute[74959]:     <system>
Nov 28 22:59:21 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:59:21 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:59:21 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:59:21 user nova-compute[74959]:       <entry name="serial">ab7dbb0e-6b7e-4250-b0b9-23307c335494</entry>
Nov 28 22:59:21 user nova-compute[74959]:       <entry name="uuid">ab7dbb0e-6b7e-4250-b0b9-23307c335494</entry>
Nov 28 22:59:21 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:59:21 user nova-compute[74959]:     </system>
Nov 28 22:59:21 user nova-compute[74959]:   </sysinfo>
Nov 28 22:59:21 user nova-compute[74959]:   <os>
Nov 28 22:59:21 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:59:21 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:59:21 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:59:21 user nova-compute[74959]:   </os>
Nov 28 22:59:21 user nova-compute[74959]:   <features>
Nov 28 22:59:21 user nova-compute[74959]:     <acpi/>
Nov 28 22:59:21 user nova-compute[74959]:     <apic/>
Nov 28 22:59:21 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:59:21 user nova-compute[74959]:   </features>
Nov 28 22:59:21 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:59:21 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:59:21 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:59:21 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:59:21 user nova-compute[74959]:   </clock>
Nov 28 22:59:21 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:59:21 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:59:21 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:59:21 user nova-compute[74959]:   </cpu>
Nov 28 22:59:21 user nova-compute[74959]:   <devices>
Nov 28 22:59:21 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:59:21 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:59:21 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk"/>
Nov 28 22:59:21 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:59:21 user nova-compute[74959]:     </disk>
Nov 28 22:59:21 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:59:21 user nova-compute[74959]:       <mac address="fa:16:3e:c1:44:5b"/>
Nov 28 22:59:21 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:21 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:59:21 user nova-compute[74959]:       <target dev="tap298ec03c-3f"/>
Nov 28 22:59:21 user nova-compute[74959]:     </interface>
Nov 28 22:59:21 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:59:21 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/console.log" append="off"/>
Nov 28 22:59:21 user nova-compute[74959]:     </serial>
Nov 28 22:59:21 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:59:21 user nova-compute[74959]:     <video>
Nov 28 22:59:21 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:21 user nova-compute[74959]:     </video>
Nov 28 22:59:21 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:59:21 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:59:21 user nova-compute[74959]:     </rng>
Nov 28 22:59:21 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:59:21 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:59:21 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:59:21 user nova-compute[74959]:     </memballoon>
Nov 28 22:59:21 user nova-compute[74959]:   </devices>
Nov 28 22:59:21 user nova-compute[74959]: </domain>
Nov 28 22:59:21 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2073362192',display_name='tempest-TestVolumeSwap-server-2073362192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2073362192',id=10,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr4hqwyEHqYoVQNT+MJNmmA6EKKdefBhWXvleHaZgLmwamfNJU1wuLK4IhL4LPK4AmeaKhwsSuw1ZV4+Ujgevxt4f43D2QTgMGBVSSK5CH4YeKcHc9kYj8cJFDRdFO+JQ==',key_name='tempest-keypair-464840639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cf04da378904e228154c55fcbd6447b',ramdisk_id='',reservation_id='r-6it2kxel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2071277782',owner_user_name='tempest-TestVolumeSwap-2071277782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55566c37576a40198a8589b801efc04e',uuid=ab7dbb0e-6b7e-4250-b0b9-23307c335494,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Converting VIF {"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:44:5b,bridge_name='br-int',has_traffic_filtering=True,id=298ec03c-3fde-4afb-a05e-fff5d0b2af54,network=Network(e69e37f5-b4e8-4c17-b4fc-99425486596b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ec03c-3f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG os_vif [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:44:5b,bridge_name='br-int',has_traffic_filtering=True,id=298ec03c-3fde-4afb-a05e-fff5d0b2af54,network=Network(e69e37f5-b4e8-4c17-b4fc-99425486596b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ec03c-3f') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00f0c290-d70a-5ded-8d4e-afa5046cf4ac', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap298ec03c-3f, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap298ec03c-3f, col_values=(('qos', UUID('73e39c96-5344-41f5-a095-7f5766e7aa1b')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap298ec03c-3f, col_values=(('external_ids', {'iface-id': '298ec03c-3fde-4afb-a05e-fff5d0b2af54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:44:5b', 'vm-uuid': 'ab7dbb0e-6b7e-4250-b0b9-23307c335494'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: INFO os_vif [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:44:5b,bridge_name='br-int',has_traffic_filtering=True,id=298ec03c-3fde-4afb-a05e-fff5d0b2af54,network=Network(e69e37f5-b4e8-4c17-b4fc-99425486596b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ec03c-3f')
Nov 28 22:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] No VIF found with MAC fa:16:3e:c1:44:5b, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.network.neutron [req-b9725f2a-4b43-49e8-8337-e72378ba6e08 req-bd1d3187-4bb7-4400-b744-0083c901322f service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Updated VIF entry in instance network info cache for port 298ec03c-3fde-4afb-a05e-fff5d0b2af54. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG nova.network.neutron [req-b9725f2a-4b43-49e8-8337-e72378ba6e08 req-bd1d3187-4bb7-4400-b744-0083c901322f service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Updating instance_info_cache with network_info: [{"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b9725f2a-4b43-49e8-8337-e72378ba6e08 req-bd1d3187-4bb7-4400-b744-0083c901322f service nova] Releasing lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-90b420b8-c12e-43a9-aa0b-523b54ca9bca req-645f5286-c1f3-4a4c-b32d-50c999e728d7 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received event network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-90b420b8-c12e-43a9-aa0b-523b54ca9bca req-645f5286-c1f3-4a4c-b32d-50c999e728d7 service nova] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-90b420b8-c12e-43a9-aa0b-523b54ca9bca req-645f5286-c1f3-4a4c-b32d-50c999e728d7 service nova] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-90b420b8-c12e-43a9-aa0b-523b54ca9bca req-645f5286-c1f3-4a4c-b32d-50c999e728d7 service nova] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-90b420b8-c12e-43a9-aa0b-523b54ca9bca req-645f5286-c1f3-4a4c-b32d-50c999e728d7 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] No waiting events found dispatching network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:22 user nova-compute[74959]: WARNING nova.compute.manager [req-90b420b8-c12e-43a9-aa0b-523b54ca9bca req-645f5286-c1f3-4a4c-b32d-50c999e728d7 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received unexpected event network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce for instance with vm_state active and task_state None.
Nov 28 22:59:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:59:23 user nova-compute[74959]: INFO nova.compute.claims [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Claim successful on node user
Nov 28 22:59:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-0a093744-b13e-4f00-b75a-61f90d20ca56 req-eed96d4c-873f-402a-bb43-2d951640486b service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received event network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0a093744-b13e-4f00-b75a-61f90d20ca56 req-eed96d4c-873f-402a-bb43-2d951640486b service nova] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0a093744-b13e-4f00-b75a-61f90d20ca56 req-eed96d4c-873f-402a-bb43-2d951640486b service nova] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0a093744-b13e-4f00-b75a-61f90d20ca56 req-eed96d4c-873f-402a-bb43-2d951640486b service nova] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-0a093744-b13e-4f00-b75a-61f90d20ca56 req-eed96d4c-873f-402a-bb43-2d951640486b service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] No waiting events found dispatching network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:24 user nova-compute[74959]: WARNING nova.compute.manager [req-0a093744-b13e-4f00-b75a-61f90d20ca56 req-eed96d4c-873f-402a-bb43-2d951640486b service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received unexpected event network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce for instance with vm_state active and task_state None.
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:59:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.policy [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ffbeb9c8d5d4e1ca4d2221ec6bdab9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503d169a75fb4c7b9e7840d525536f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 22:59:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Creating image(s)
Nov 28 22:59:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "/opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "/opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.226s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.236s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk 1073741824" returned: 0 in 0.080s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Successfully created port: e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Cannot resize image /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Ensure instance console log exists: /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Successfully updated port: e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquired lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-be70dc1a-9c22-4c85-b8d7-3071d8d502e3 req-17c0bfd4-c9d2-4708-bea2-934b22d6ec54 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received event network-changed-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-be70dc1a-9c22-4c85-b8d7-3071d8d502e3 req-17c0bfd4-c9d2-4708-bea2-934b22d6ec54 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Refreshing instance network info cache due to event network-changed-e9513da7-b67d-4b0f-b277-5c533a317db1. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-be70dc1a-9c22-4c85-b8d7-3071d8d502e3 req-17c0bfd4-c9d2-4708-bea2-934b22d6ec54 service nova] Acquiring lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Updating instance_info_cache with network_info: [{"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Releasing lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Instance network_info: |[{"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-be70dc1a-9c22-4c85-b8d7-3071d8d502e3 req-17c0bfd4-c9d2-4708-bea2-934b22d6ec54 service nova] Acquired lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-be70dc1a-9c22-4c85-b8d7-3071d8d502e3 req-17c0bfd4-c9d2-4708-bea2-934b22d6ec54 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Refreshing network info cache for port e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Start _get_guest_xml network_info=[{"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 22:59:26 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:26 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1109565946',display_name='tempest-VolumesAssistedSnapshotsTest-server-1109565946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1109565946',id=11,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsqVnLCMe34EDJQQrghlZbZXBycl8oazZSwLbt6y6h5ytmL5UK0t+kCc0AglJ+zA5PfjIuyfYuO4YWAb0DKRifxRTsmlF6lVTYJ6fmKLzkV+ncEwXVdrY8q9zE1Elu2qQ==',key_name='tempest-keypair-106570242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='503d169a75fb4c7b9e7840d525536f93',ramdisk_id='',reservation_id='r-rzywrjp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1401385343',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1401385343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffbeb9c8d5d4e1ca4d2221ec6bdab9c',uuid=d0d20108-9362-4586-9d9d-88522ce58ad7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Converting VIF {"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:f9,bridge_name='br-int',has_traffic_filtering=True,id=e9513da7-b67d-4b0f-b277-5c533a317db1,network=Network(bf708527-3c3d-4dbe-aae7-01e87def40ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9513da7-b6') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lazy-loading 'pci_devices' on Instance uuid d0d20108-9362-4586-9d9d-88522ce58ad7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 22:59:26 user nova-compute[74959]:   <uuid>d0d20108-9362-4586-9d9d-88522ce58ad7</uuid>
Nov 28 22:59:26 user nova-compute[74959]:   <name>instance-0000000b</name>
Nov 28 22:59:26 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 22:59:26 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 22:59:26 user nova-compute[74959]:   <metadata>
Nov 28 22:59:26 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 22:59:26 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 22:59:26 user nova-compute[74959]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1109565946</nova:name>
Nov 28 22:59:26 user nova-compute[74959]:       <nova:creationTime>2023-11-28 22:59:26</nova:creationTime>
Nov 28 22:59:26 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 22:59:26 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 22:59:26 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 22:59:26 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 22:59:26 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 22:59:26 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 22:59:26 user nova-compute[74959]:       </nova:flavor>
Nov 28 22:59:26 user nova-compute[74959]:       <nova:owner>
Nov 28 22:59:26 user nova-compute[74959]:         <nova:user uuid="0ffbeb9c8d5d4e1ca4d2221ec6bdab9c">tempest-VolumesAssistedSnapshotsTest-1401385343-project-member</nova:user>
Nov 28 22:59:26 user nova-compute[74959]:         <nova:project uuid="503d169a75fb4c7b9e7840d525536f93">tempest-VolumesAssistedSnapshotsTest-1401385343</nova:project>
Nov 28 22:59:26 user nova-compute[74959]:       </nova:owner>
Nov 28 22:59:26 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 22:59:26 user nova-compute[74959]:       <nova:ports>
Nov 28 22:59:26 user nova-compute[74959]:         <nova:port uuid="e9513da7-b67d-4b0f-b277-5c533a317db1">
Nov 28 22:59:26 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 22:59:26 user nova-compute[74959]:         </nova:port>
Nov 28 22:59:26 user nova-compute[74959]:       </nova:ports>
Nov 28 22:59:26 user nova-compute[74959]:     </nova:instance>
Nov 28 22:59:26 user nova-compute[74959]:   </metadata>
Nov 28 22:59:26 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 22:59:26 user nova-compute[74959]:     <system>
Nov 28 22:59:26 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 22:59:26 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 22:59:26 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 22:59:26 user nova-compute[74959]:       <entry name="serial">d0d20108-9362-4586-9d9d-88522ce58ad7</entry>
Nov 28 22:59:26 user nova-compute[74959]:       <entry name="uuid">d0d20108-9362-4586-9d9d-88522ce58ad7</entry>
Nov 28 22:59:26 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 22:59:26 user nova-compute[74959]:     </system>
Nov 28 22:59:26 user nova-compute[74959]:   </sysinfo>
Nov 28 22:59:26 user nova-compute[74959]:   <os>
Nov 28 22:59:26 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 22:59:26 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 22:59:26 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 22:59:26 user nova-compute[74959]:   </os>
Nov 28 22:59:26 user nova-compute[74959]:   <features>
Nov 28 22:59:26 user nova-compute[74959]:     <acpi/>
Nov 28 22:59:26 user nova-compute[74959]:     <apic/>
Nov 28 22:59:26 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 22:59:26 user nova-compute[74959]:   </features>
Nov 28 22:59:26 user nova-compute[74959]:   <clock offset="utc">
Nov 28 22:59:26 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 22:59:26 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 22:59:26 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 22:59:26 user nova-compute[74959]:   </clock>
Nov 28 22:59:26 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 22:59:26 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 22:59:26 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 22:59:26 user nova-compute[74959]:   </cpu>
Nov 28 22:59:26 user nova-compute[74959]:   <devices>
Nov 28 22:59:26 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 22:59:26 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 22:59:26 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk"/>
Nov 28 22:59:26 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 22:59:26 user nova-compute[74959]:     </disk>
Nov 28 22:59:26 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 22:59:26 user nova-compute[74959]:       <mac address="fa:16:3e:04:00:f9"/>
Nov 28 22:59:26 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:26 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 22:59:26 user nova-compute[74959]:       <target dev="tape9513da7-b6"/>
Nov 28 22:59:26 user nova-compute[74959]:     </interface>
Nov 28 22:59:26 user nova-compute[74959]:     <serial type="pty">
Nov 28 22:59:26 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/console.log" append="off"/>
Nov 28 22:59:26 user nova-compute[74959]:     </serial>
Nov 28 22:59:26 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 22:59:26 user nova-compute[74959]:     <video>
Nov 28 22:59:26 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 22:59:26 user nova-compute[74959]:     </video>
Nov 28 22:59:26 user nova-compute[74959]:     <rng model="virtio">
Nov 28 22:59:26 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 22:59:26 user nova-compute[74959]:     </rng>
Nov 28 22:59:26 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 22:59:26 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 22:59:26 user nova-compute[74959]:       <stats period="10"/>
Nov 28 22:59:26 user nova-compute[74959]:     </memballoon>
Nov 28 22:59:26 user nova-compute[74959]:   </devices>
Nov 28 22:59:26 user nova-compute[74959]: </domain>
Nov 28 22:59:26 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1109565946',display_name='tempest-VolumesAssistedSnapshotsTest-server-1109565946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1109565946',id=11,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsqVnLCMe34EDJQQrghlZbZXBycl8oazZSwLbt6y6h5ytmL5UK0t+kCc0AglJ+zA5PfjIuyfYuO4YWAb0DKRifxRTsmlF6lVTYJ6fmKLzkV+ncEwXVdrY8q9zE1Elu2qQ==',key_name='tempest-keypair-106570242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='503d169a75fb4c7b9e7840d525536f93',ramdisk_id='',reservation_id='r-rzywrjp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1401385343',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1401385343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffbeb9c8d5d4e1ca4d2221ec6bdab9c',uuid=d0d20108-9362-4586-9d9d-88522ce58ad7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Converting VIF {"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:f9,bridge_name='br-int',has_traffic_filtering=True,id=e9513da7-b67d-4b0f-b277-5c533a317db1,network=Network(bf708527-3c3d-4dbe-aae7-01e87def40ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9513da7-b6') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG os_vif [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:f9,bridge_name='br-int',has_traffic_filtering=True,id=e9513da7-b67d-4b0f-b277-5c533a317db1,network=Network(bf708527-3c3d-4dbe-aae7-01e87def40ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9513da7-b6') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07978263-e9b2-5578-8dc2-c1aff053e1ed', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9513da7-b6, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9513da7-b6, col_values=(('qos', UUID('54b2f1fb-3fd7-4aa1-8837-e58377477246')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9513da7-b6, col_values=(('external_ids', {'iface-id': 'e9513da7-b67d-4b0f-b277-5c533a317db1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:00:f9', 'vm-uuid': 'd0d20108-9362-4586-9d9d-88522ce58ad7'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 22:59:26 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Instance spawned successfully.
Nov 28 22:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:26 user nova-compute[74959]: INFO os_vif [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:00:f9,bridge_name='br-int',has_traffic_filtering=True,id=e9513da7-b67d-4b0f-b277-5c533a317db1,network=Network(bf708527-3c3d-4dbe-aae7-01e87def40ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9513da7-b6')
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] No VIF found with MAC fa:16:3e:04:00:f9, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 22:59:27 user nova-compute[74959]: INFO nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Took 14.80 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-be70dc1a-9c22-4c85-b8d7-3071d8d502e3 req-17c0bfd4-c9d2-4708-bea2-934b22d6ec54 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Updated VIF entry in instance network info cache for port e9513da7-b67d-4b0f-b277-5c533a317db1. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-be70dc1a-9c22-4c85-b8d7-3071d8d502e3 req-17c0bfd4-c9d2-4708-bea2-934b22d6ec54 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Updating instance_info_cache with network_info: [{"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:27 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Instance spawned successfully.
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:27 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Instance spawned successfully.
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-be70dc1a-9c22-4c85-b8d7-3071d8d502e3 req-17c0bfd4-c9d2-4708-bea2-934b22d6ec54 service nova] Releasing lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:27 user nova-compute[74959]: INFO nova.compute.manager [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Took 16.53 seconds to build instance.
Nov 28 22:59:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb2b0955-d766-46cb-a52f-af99c0d60fc1 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.733s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:27 user nova-compute[74959]: INFO nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Took 9.44 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:27 user nova-compute[74959]: INFO nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Took 13.14 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:27 user nova-compute[74959]: INFO nova.compute.manager [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Took 16.03 seconds to build instance.
Nov 28 22:59:27 user nova-compute[74959]: INFO nova.compute.manager [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Took 11.07 seconds to build instance.
Nov 28 22:59:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4c9f7460-fa7b-42bd-9911-1452f3cac3a5 tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.349s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a6ff748e-13cd-4af3-853e-6365f26a143a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.185s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-c99e3529-afef-4c5f-a353-060169eff459 req-f7f7d42c-9751-4e5a-a304-f383e662e260 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received event network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c99e3529-afef-4c5f-a353-060169eff459 req-f7f7d42c-9751-4e5a-a304-f383e662e260 service nova] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c99e3529-afef-4c5f-a353-060169eff459 req-f7f7d42c-9751-4e5a-a304-f383e662e260 service nova] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c99e3529-afef-4c5f-a353-060169eff459 req-f7f7d42c-9751-4e5a-a304-f383e662e260 service nova] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-c99e3529-afef-4c5f-a353-060169eff459 req-f7f7d42c-9751-4e5a-a304-f383e662e260 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] No waiting events found dispatching network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:28 user nova-compute[74959]: WARNING nova.compute.manager [req-c99e3529-afef-4c5f-a353-060169eff459 req-f7f7d42c-9751-4e5a-a304-f383e662e260 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received unexpected event network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 for instance with vm_state active and task_state None.
Nov 28 22:59:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-1789309a-aecb-44f6-8667-a89be17ea79f req-8dd70761-147c-42fa-9223-6459a2679aa3 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received event network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1789309a-aecb-44f6-8667-a89be17ea79f req-8dd70761-147c-42fa-9223-6459a2679aa3 service nova] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1789309a-aecb-44f6-8667-a89be17ea79f req-8dd70761-147c-42fa-9223-6459a2679aa3 service nova] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1789309a-aecb-44f6-8667-a89be17ea79f req-8dd70761-147c-42fa-9223-6459a2679aa3 service nova] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-1789309a-aecb-44f6-8667-a89be17ea79f req-8dd70761-147c-42fa-9223-6459a2679aa3 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] No waiting events found dispatching network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:30 user nova-compute[74959]: WARNING nova.compute.manager [req-1789309a-aecb-44f6-8667-a89be17ea79f req-8dd70761-147c-42fa-9223-6459a2679aa3 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received unexpected event network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 for instance with vm_state active and task_state None.
Nov 28 22:59:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 22:59:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 22:59:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Instance spawned successfully.
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Skipping network cache update for instance because it is Building. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 22:59:31 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 22:59:32 user nova-compute[74959]: INFO nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 28 22:59:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 22:59:32 user nova-compute[74959]: INFO nova.compute.manager [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Took 8.80 seconds to build instance.
Nov 28 22:59:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b4aa3e6f-e4ad-496d-99e5-53383eb1a5a8 tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.089s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:32 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updating instance_info_cache with network_info: [{"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 22:59:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 22:59:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-f4d50ded-549b-4d02-aa30-f417858f8390 req-d6ecb5da-6873-4add-bd45-b85c8daace83 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4d50ded-549b-4d02-aa30-f417858f8390 req-d6ecb5da-6873-4add-bd45-b85c8daace83 service nova] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4d50ded-549b-4d02-aa30-f417858f8390 req-d6ecb5da-6873-4add-bd45-b85c8daace83 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4d50ded-549b-4d02-aa30-f417858f8390 req-d6ecb5da-6873-4add-bd45-b85c8daace83 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-f4d50ded-549b-4d02-aa30-f417858f8390 req-d6ecb5da-6873-4add-bd45-b85c8daace83 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] No waiting events found dispatching network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:35 user nova-compute[74959]: WARNING nova.compute.manager [req-f4d50ded-549b-4d02-aa30-f417858f8390 req-d6ecb5da-6873-4add-bd45-b85c8daace83 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received unexpected event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 for instance with vm_state active and task_state None.
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] No waiting events found dispatching network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:37 user nova-compute[74959]: WARNING nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received unexpected event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 for instance with vm_state active and task_state None.
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:37 user nova-compute[74959]: WARNING nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state active and task_state None.
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:37 user nova-compute[74959]: WARNING nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state active and task_state None.
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received event network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] No waiting events found dispatching network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:37 user nova-compute[74959]: WARNING nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received unexpected event network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d for instance with vm_state active and task_state None.
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received event network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] No waiting events found dispatching network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:37 user nova-compute[74959]: WARNING nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received unexpected event network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d for instance with vm_state active and task_state None.
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] No waiting events found dispatching network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:37 user nova-compute[74959]: WARNING nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received unexpected event network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 for instance with vm_state active and task_state None.
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] No waiting events found dispatching network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:37 user nova-compute[74959]: WARNING nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received unexpected event network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 for instance with vm_state active and task_state None.
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received event network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] No waiting events found dispatching network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:37 user nova-compute[74959]: WARNING nova.compute.manager [req-f80e513a-4bdf-4049-8f7d-7da2145f6746 req-532ba667-3a18-4550-b373-c5cb93e3d1ae service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received unexpected event network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 for instance with vm_state active and task_state None.
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ac8d1a8-abc8-44f8-b7df-14e651b3d9dd req-ce3673eb-0808-4eca-a595-f433ed9163ed service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received event network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ac8d1a8-abc8-44f8-b7df-14e651b3d9dd req-ce3673eb-0808-4eca-a595-f433ed9163ed service nova] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ac8d1a8-abc8-44f8-b7df-14e651b3d9dd req-ce3673eb-0808-4eca-a595-f433ed9163ed service nova] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ac8d1a8-abc8-44f8-b7df-14e651b3d9dd req-ce3673eb-0808-4eca-a595-f433ed9163ed service nova] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ac8d1a8-abc8-44f8-b7df-14e651b3d9dd req-ce3673eb-0808-4eca-a595-f433ed9163ed service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] No waiting events found dispatching network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:39 user nova-compute[74959]: WARNING nova.compute.manager [req-4ac8d1a8-abc8-44f8-b7df-14e651b3d9dd req-ce3673eb-0808-4eca-a595-f433ed9163ed service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received unexpected event network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 for instance with vm_state active and task_state None.
Nov 28 22:59:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7415MB free_disk=25.652210235595703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 3e471897-443d-4b80-b60a-dad06cbe21f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 94b085b2-b298-4780-be94-21f85c799945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d339c51b-2c03-4ac9-800f-b5dc053e0585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 17495411-b15b-4660-b2fe-42749b11ed49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6c504232-f516-4764-8df1-7bff0a3bd413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d0d20108-9362-4586-9d9d-88522ce58ad7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 22:59:40 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 22:59:41 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:59:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:59:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 22:59:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.942s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 22:59:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 22:59:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-5eddbbf5-8739-479a-bd43-4b165590dd3a req-a150a6cf-d21f-44c2-afdf-f88fa6c32973 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received event network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5eddbbf5-8739-479a-bd43-4b165590dd3a req-a150a6cf-d21f-44c2-afdf-f88fa6c32973 service nova] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5eddbbf5-8739-479a-bd43-4b165590dd3a req-a150a6cf-d21f-44c2-afdf-f88fa6c32973 service nova] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5eddbbf5-8739-479a-bd43-4b165590dd3a req-a150a6cf-d21f-44c2-afdf-f88fa6c32973 service nova] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-5eddbbf5-8739-479a-bd43-4b165590dd3a req-a150a6cf-d21f-44c2-afdf-f88fa6c32973 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] No waiting events found dispatching network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:45 user nova-compute[74959]: WARNING nova.compute.manager [req-5eddbbf5-8739-479a-bd43-4b165590dd3a req-a150a6cf-d21f-44c2-afdf-f88fa6c32973 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received unexpected event network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 for instance with vm_state active and task_state None.
Nov 28 22:59:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ca665c8-3d98-407c-972a-6374b7c619a9 req-fb346451-bf4c-41ac-b51e-f4ab6aae8da1 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received event network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ca665c8-3d98-407c-972a-6374b7c619a9 req-fb346451-bf4c-41ac-b51e-f4ab6aae8da1 service nova] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ca665c8-3d98-407c-972a-6374b7c619a9 req-fb346451-bf4c-41ac-b51e-f4ab6aae8da1 service nova] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ca665c8-3d98-407c-972a-6374b7c619a9 req-fb346451-bf4c-41ac-b51e-f4ab6aae8da1 service nova] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ca665c8-3d98-407c-972a-6374b7c619a9 req-fb346451-bf4c-41ac-b51e-f4ab6aae8da1 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] No waiting events found dispatching network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 22:59:47 user nova-compute[74959]: WARNING nova.compute.manager [req-4ca665c8-3d98-407c-972a-6374b7c619a9 req-fb346451-bf4c-41ac-b51e-f4ab6aae8da1 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received unexpected event network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 for instance with vm_state active and task_state None.
Nov 28 22:59:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 22:59:51 user nova-compute[74959]: INFO nova.compute.claims [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Claim successful on node user
Nov 28 22:59:51 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 22:59:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 22:59:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 22:59:52 user nova-compute[74959]: INFO nova.virt.block_device [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Booting with volume 8dea671a-a203-4b61-a173-255882c76441 at /dev/vda
Nov 28 22:59:52 user nova-compute[74959]: DEBUG nova.policy [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c7b3a0f45fc4541921ff54450dca885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33e0d58accb48f3ac6d76cf67785665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 22:59:52 user nova-compute[74959]: DEBUG os_brick.utils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 22:59:52 user nova-compute[74959]: INFO oslo.privsep.daemon [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmplwjw5b58/privsep.sock']
Nov 28 22:59:52 user sudo[86628]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmplwjw5b58/privsep.sock
Nov 28 22:59:52 user sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 22:59:52 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully created port: 9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully created port: 16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:53 user sudo[86628]: pam_unix(sudo:session): session closed for user root
Nov 28 22:59:53 user nova-compute[74959]: INFO oslo.privsep.daemon [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Spawned new privsep daemon via rootwrap
Nov 28 22:59:53 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 22:59:53 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 22:59:53 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 22:59:53 user nova-compute[74959]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86637
Nov 28 22:59:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[73022c35-cedc-4004-9325-9eead071e737]: (2,) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 22:59:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully created port: ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[feff9f5d-5c88-4556-941d-b63936358f69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 22:59:54 user nova-compute[74959]: WARNING os_brick.initiator.connectors.nvmeof [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42dee00-efcd-4d0f-8196-4327adf8aaa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d368e41e-8964-4701-869f-e08cfc766d27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6e191c-fd93-4f1c-b45c-ccda06130645]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 22:59:54 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 22:59:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfe0a9c-8e78-475a-91d2-aebf1ab4c461]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG os_brick.utils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== get_connector_properties: return (2060ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating existing volume attachment record: 6cd59f83-9fc8-4adb-bcc3-7b47f5eda5ec {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully created port: 695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully created port: 5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 22:59:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully updated port: 9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-9f7b29df-2c7b-4743-9dec-0585b297bcd0 req-9fbd45b8-014c-4897-b3ff-b7769e2891d9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-changed-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-9f7b29df-2c7b-4743-9dec-0585b297bcd0 req-9fbd45b8-014c-4897-b3ff-b7769e2891d9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing instance network info cache due to event network-changed-9b5b8018-5907-4de7-8843-9486b57ab8e8. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9f7b29df-2c7b-4743-9dec-0585b297bcd0 req-9fbd45b8-014c-4897-b3ff-b7769e2891d9 service nova] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9f7b29df-2c7b-4743-9dec-0585b297bcd0 req-9fbd45b8-014c-4897-b3ff-b7769e2891d9 service nova] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:55 user nova-compute[74959]: DEBUG nova.network.neutron [req-9f7b29df-2c7b-4743-9dec-0585b297bcd0 req-9fbd45b8-014c-4897-b3ff-b7769e2891d9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing network info cache for port 9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:55 user nova-compute[74959]: DEBUG nova.network.neutron [req-9f7b29df-2c7b-4743-9dec-0585b297bcd0 req-9fbd45b8-014c-4897-b3ff-b7769e2891d9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:56 user nova-compute[74959]: DEBUG nova.network.neutron [req-9f7b29df-2c7b-4743-9dec-0585b297bcd0 req-9fbd45b8-014c-4897-b3ff-b7769e2891d9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9f7b29df-2c7b-4743-9dec-0585b297bcd0 req-9fbd45b8-014c-4897-b3ff-b7769e2891d9 service nova] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully updated port: 9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 22:59:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully updated port: 77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully updated port: 16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-changed-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing instance network info cache due to event network-changed-9f29a5d6-1528-4d78-a307-071b8f187b89. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:57 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing network info cache for port 9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully updated port: ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-changed-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing instance network info cache due to event network-changed-77780988-92a8-4524-96bf-e9b8a8420e13. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing network info cache for port 77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-changed-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing instance network info cache due to event network-changed-16be754f-128d-42bb-9e0b-f8109e822537. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing network info cache for port 16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-579d014e-e5e8-44fd-b76c-a6898aadf6f6 req-04d061d9-ea1e-49c6-83d1-96f6456e8636 service nova] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 22:59:58 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully updated port: 695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:59 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Successfully updated port: 5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 22:59:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 22:59:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 22:59:59 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 22:59:59 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 22:59:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-changed-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 22:59:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing instance network info cache due to event network-changed-ea1a1907-61d6-4b6d-82cf-69c2cf228e37. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 22:59:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:01 user nova-compute[74959]: INFO nova.virt.block_device [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Booting with volume 26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 at /dev/vdb
Nov 28 23:00:01 user nova-compute[74959]: DEBUG os_brick.utils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[05980f70-2168-443b-b1d4-475348e829d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f450ee-a1c8-471a-bbba-100847fe0fb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe84c05-6486-4872-994a-23c0a02e32f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf3aa08-0510-4d92-8ab1-0f23d14a9775]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:01 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e3b6c9-d0a6-4b79-99a7-67e64f804240]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG os_brick.utils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating existing volume attachment record: 4dd2cd06-c1d1-4327-8c1a-7e1ffac46bbb {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [{"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance network_info: |[{"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing network info cache for port ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updated VIF entry in instance network info cache for port ea1a1907-61d6-4b6d-82cf-69c2cf228e37. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [{"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-changed-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing instance network info cache due to event network-changed-695be666-a837-4bd3-bd97-88e22aeec0db. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing network info cache for port 695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updated VIF entry in instance network info cache for port 695be666-a837-4bd3-bd97-88e22aeec0db. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [{"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-changed-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing instance network info cache due to event network-changed-5de45185-2b05-4a71-9c0a-da897f1567a6. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing network info cache for port 5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updated VIF entry in instance network info cache for port 5de45185-2b05-4a71-9c0a-da897f1567a6. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [{"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9c07ddaa-5e4d-4d0f-a7a7-a8b135b1d67c req-2f44240d-e6ae-41ad-84df-f9b6cc620f43 service nova] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:08 user nova-compute[74959]: INFO nova.virt.block_device [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Booting with volume cd287388-5802-471c-ac44-075a1a703a8c at /dev/vdc
Nov 28 23:00:08 user nova-compute[74959]: DEBUG os_brick.utils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfeff3f-0bec-49d6-8e32-d6702149e2a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe58a20-3f8a-48f6-8f65-2e08a9676bb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3496612b-c04a-4743-b3e3-35c58ab3a1bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf1019-c78a-4805-b7fe-fed1089f8482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:08 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:00:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e021d12b-1360-43b5-ba0e-3e556af92c3b]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG os_brick.utils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:08 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating existing volume attachment record: 9f862997-9029-406e-b747-069da7d5f589 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:00:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:00:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Creating image(s)
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Ensure instance console log exists: /opt/stack/data/nova/instances/9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Start _get_guest_xml network_info=[{"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HZkUsQbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1', 'attached_at': '', 'detached_at': '', 'volume_id': '8dea671a-a203-4b61-a173-255882c76441', 'serial': '8dea671a-a203-4b61-a173-255882c76441'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '6cd59f83-9fc8-4adb-bcc3-7b47f5eda5ec', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AosnWKgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1', 'attached_at': '', 'detached_at': '', 'volume_id': '26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6', 'serial': '26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6'}, 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '4dd2cd06-c1d1-4327-8c1a-7e1ffac46bbb', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaTOBwtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd287388-5802-471c-ac44-075a1a703a8c', 'serial': 'cd287388-5802-471c-ac44-075a1a703a8c'}, 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': '9f862997-9029-406e-b747-069da7d5f589', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:00:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:00:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connector [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Factory for ISCSI on None {{(pid=74959) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HZkUsQbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:15 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:15 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:15 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1792fc8c-9e3f-4ed3-bf12-ed3c52b9f0f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:00:15 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9445df-97c9-4126-bdcb-d5f1dcf142e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441] added
Nov 28 23:00:15 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d30344-0fc0-4f6a-94c0-158680c2ad55]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[948499ac-5cee-4b5d-9647-a72d6ad5696d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HZkUsQbO {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HZkUsQbO" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0c3650-16a9-414a-9e2e-1cce5281dbed]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HZkUsQbO'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d5e5f7-169e-45ea-b5b1-a5e8f6059916]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c92b59e-8a6b-446f-b7e7-82f49052114f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:00:15 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:00:15 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:15 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:00:15 user nova-compute[74959]: 
Nov 28 23:00:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --login" returned: 0 in 1.048s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d814225-1b96-48e9-938a-b7a704ff4494]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441, portal: 172.16.0.220,3260]
Nov 28 23:00:16 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441, portal: 172.16.0.220,3260] successful.
Nov 28 23:00:16 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046c0bf-c845-4808-87b4-2b0ee7785571]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1326cbc-340f-4804-8447-b08fbc785d34]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:16 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:16 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[288e2e61-2d88-4e58-8e3e-14fc245ae15b]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:00:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HZkUsQbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.270s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== connect_volume: return (2271ms) {'type': 'block', 'scsi_wwn': '23136626138623331', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136626138623331', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AosnWKgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:17 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:17 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:17 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[759a9fd9-a16e-4d0f-a2f7-9d6db5cb410b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:00:17 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef6e9b1-3b91-4753-861c-258f06ff3077]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6] added
Nov 28 23:00:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1ff7c7-da59-486a-9975-acde2a3aae17]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20dc5bb-1b51-4394-8f0f-01d8f2697167]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AosnWKgI {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AosnWKgI" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09345f0-3836-4f3f-b6d4-1d2cf2417601]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AosnWKgI'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c13af7-0286-412e-b4e5-fd078d68d0f6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d37bde-6987-4dd8-aefa-e54178adc2fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cfc87a-2da6-410d-b78a-e5344b217814]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6, portal: 172.16.0.220,3260]
Nov 28 23:00:17 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6, portal: 172.16.0.220,3260] successful.
Nov 28 23:00:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f98023-2cc4-46ca-8c46-45e17f2dc5d9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db86a8f-35f6-41e7-99d2-aca16af93372]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:17 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:17 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffef9ca-de2d-4280-b355-eebf6abbb644]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:00:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AosnWKgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26535343431373234', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535343431373234', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaTOBwtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:18 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:18 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:18 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc9c078-ba86-46d5-b8a9-717e0f586137]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:00:18 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[47162c90-b617-4c68-bd5c-b74eef3b6a05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c] added
Nov 28 23:00:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7787c8f-5958-411a-977a-7dee6597f67e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd9f7d-f286-46b0-8a87-1d53406558bc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MaTOBwtc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MaTOBwtc" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae0e7b8-7492-4a57-b4ae-aa66cd91f3d0]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MaTOBwtc'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e7b7bc-ed8f-4cd4-aed5-d039729dee90]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a12027-de86-465b-829d-1eaf14787585]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:18 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:18 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3fbab-a168-46eb-a85c-97dd4a517947]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c, portal: 172.16.0.220,3260]
Nov 28 23:00:19 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c, portal: 172.16.0.220,3260] successful.
Nov 28 23:00:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f4bd57-4c5b-4e72-a59a-6e8a22cbaf92]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3112b99-cf5c-44a8-9e65-35dd932cf0db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:19 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:19 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:00:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:19 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:19 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:00:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebeb404-bca6-43a1-9eb6-947344533aba]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:19 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaTOBwtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23433373230376466', 'path': '/dev/sdd'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433373230376466', 'path': '/dev/sdd'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:91:67,bridge_name='br-int',has_traffic_filtering=True,id=9b5b8018-5907-4de7-8843-9486b57ab8e8,network=Network(f307cfd0-85ad-4016-8def-253dbd765bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5b8018-59') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=9f29a5d6-1528-4d78-a307-071b8f187b89,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f29a5d6-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:55:5b,bridge_name='br-int',has_traffic_filtering=True,id=77780988-92a8-4524-96bf-e9b8a8420e13,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77780988-92') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:d0,bridge_name='br-int',has_traffic_filtering=True,id=16be754f-128d-42bb-9e0b-f8109e822537,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16be754f-12') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:10:07,bridge_name='br-int',has_traffic_filtering=True,id=ea1a1907-61d6-4b6d-82cf-69c2cf228e37,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1a1907-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:f8,bridge_name='br-int',has_traffic_filtering=True,id=695be666-a837-4bd3-bd97-88e22aeec0db,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695be666-a8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=5de45185-2b05-4a71-9c0a-da897f1567a6,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de45185-2b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.objects.instance [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lazy-loading 'pci_devices' on Instance uuid 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:00:20 user nova-compute[74959]:   <uuid>9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1</uuid>
Nov 28 23:00:20 user nova-compute[74959]:   <name>instance-0000000c</name>
Nov 28 23:00:20 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:00:20 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:00:20 user nova-compute[74959]:   <metadata>
Nov 28 23:00:20 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:00:20 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:00:20 user nova-compute[74959]:       <nova:name>tempest-device-tagging-server-1936747039</nova:name>
Nov 28 23:00:20 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:00:15</nova:creationTime>
Nov 28 23:00:20 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:00:20 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:00:20 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:00:20 user nova-compute[74959]:       <nova:owner>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:user uuid="8c7b3a0f45fc4541921ff54450dca885">tempest-TaggedBootDevicesTest_v242-902213869-project-member</nova:user>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:project uuid="d33e0d58accb48f3ac6d76cf67785665">tempest-TaggedBootDevicesTest_v242-902213869</nova:project>
Nov 28 23:00:20 user nova-compute[74959]:       </nova:owner>
Nov 28 23:00:20 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:00:20 user nova-compute[74959]:       <nova:ports>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:port uuid="9b5b8018-5907-4de7-8843-9486b57ab8e8">
Nov 28 23:00:20 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 23:00:20 user nova-compute[74959]:         </nova:port>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:port uuid="9f29a5d6-1528-4d78-a307-071b8f187b89">
Nov 28 23:00:20 user nova-compute[74959]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Nov 28 23:00:20 user nova-compute[74959]:         </nova:port>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:port uuid="77780988-92a8-4524-96bf-e9b8a8420e13">
Nov 28 23:00:20 user nova-compute[74959]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Nov 28 23:00:20 user nova-compute[74959]:         </nova:port>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:port uuid="16be754f-128d-42bb-9e0b-f8109e822537">
Nov 28 23:00:20 user nova-compute[74959]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Nov 28 23:00:20 user nova-compute[74959]:         </nova:port>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:port uuid="ea1a1907-61d6-4b6d-82cf-69c2cf228e37">
Nov 28 23:00:20 user nova-compute[74959]:           <nova:ip type="fixed" address="10.1.1.86" ipVersion="4"/>
Nov 28 23:00:20 user nova-compute[74959]:         </nova:port>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:port uuid="695be666-a837-4bd3-bd97-88e22aeec0db">
Nov 28 23:00:20 user nova-compute[74959]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 23:00:20 user nova-compute[74959]:         </nova:port>
Nov 28 23:00:20 user nova-compute[74959]:         <nova:port uuid="5de45185-2b05-4a71-9c0a-da897f1567a6">
Nov 28 23:00:20 user nova-compute[74959]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 23:00:20 user nova-compute[74959]:         </nova:port>
Nov 28 23:00:20 user nova-compute[74959]:       </nova:ports>
Nov 28 23:00:20 user nova-compute[74959]:     </nova:instance>
Nov 28 23:00:20 user nova-compute[74959]:   </metadata>
Nov 28 23:00:20 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:00:20 user nova-compute[74959]:     <system>
Nov 28 23:00:20 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:00:20 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:00:20 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:00:20 user nova-compute[74959]:       <entry name="serial">9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1</entry>
Nov 28 23:00:20 user nova-compute[74959]:       <entry name="uuid">9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1</entry>
Nov 28 23:00:20 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:00:20 user nova-compute[74959]:     </system>
Nov 28 23:00:20 user nova-compute[74959]:   </sysinfo>
Nov 28 23:00:20 user nova-compute[74959]:   <os>
Nov 28 23:00:20 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:00:20 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:00:20 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:00:20 user nova-compute[74959]:   </os>
Nov 28 23:00:20 user nova-compute[74959]:   <features>
Nov 28 23:00:20 user nova-compute[74959]:     <acpi/>
Nov 28 23:00:20 user nova-compute[74959]:     <apic/>
Nov 28 23:00:20 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:00:20 user nova-compute[74959]:   </features>
Nov 28 23:00:20 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:00:20 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:00:20 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:00:20 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:00:20 user nova-compute[74959]:   </clock>
Nov 28 23:00:20 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:00:20 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:00:20 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:00:20 user nova-compute[74959]:   </cpu>
Nov 28 23:00:20 user nova-compute[74959]:   <devices>
Nov 28 23:00:20 user nova-compute[74959]:     <disk type="file" device="cdrom">
Nov 28 23:00:20 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 23:00:20 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1/disk.config"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="hda" bus="ide"/>
Nov 28 23:00:20 user nova-compute[74959]:     </disk>
Nov 28 23:00:20 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:00:20 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:00:20 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <serial>8dea671a-a203-4b61-a173-255882c76441</serial>
Nov 28 23:00:20 user nova-compute[74959]:     </disk>
Nov 28 23:00:20 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:00:20 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:00:20 user nova-compute[74959]:       <source dev="/dev/sdc"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <serial>26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6</serial>
Nov 28 23:00:20 user nova-compute[74959]:     </disk>
Nov 28 23:00:20 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:00:20 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:00:20 user nova-compute[74959]:       <source dev="/dev/sdd"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="vdc" bus="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <serial>cd287388-5802-471c-ac44-075a1a703a8c</serial>
Nov 28 23:00:20 user nova-compute[74959]:     </disk>
Nov 28 23:00:20 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:00:20 user nova-compute[74959]:       <mac address="fa:16:3e:d9:91:67"/>
Nov 28 23:00:20 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="tap9b5b8018-59"/>
Nov 28 23:00:20 user nova-compute[74959]:     </interface>
Nov 28 23:00:20 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:00:20 user nova-compute[74959]:       <mac address="fa:16:3e:a0:bd:15"/>
Nov 28 23:00:20 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="tap9f29a5d6-15"/>
Nov 28 23:00:20 user nova-compute[74959]:     </interface>
Nov 28 23:00:20 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:00:20 user nova-compute[74959]:       <mac address="fa:16:3e:da:55:5b"/>
Nov 28 23:00:20 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="tap77780988-92"/>
Nov 28 23:00:20 user nova-compute[74959]:     </interface>
Nov 28 23:00:20 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:00:20 user nova-compute[74959]:       <mac address="fa:16:3e:6d:56:d0"/>
Nov 28 23:00:20 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="tap16be754f-12"/>
Nov 28 23:00:20 user nova-compute[74959]:     </interface>
Nov 28 23:00:20 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:00:20 user nova-compute[74959]:       <mac address="fa:16:3e:b3:10:07"/>
Nov 28 23:00:20 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="tapea1a1907-61"/>
Nov 28 23:00:20 user nova-compute[74959]:     </interface>
Nov 28 23:00:20 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:00:20 user nova-compute[74959]:       <mac address="fa:16:3e:89:19:f8"/>
Nov 28 23:00:20 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="tap695be666-a8"/>
Nov 28 23:00:20 user nova-compute[74959]:     </interface>
Nov 28 23:00:20 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:00:20 user nova-compute[74959]:       <mac address="fa:16:3e:14:b1:85"/>
Nov 28 23:00:20 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:00:20 user nova-compute[74959]:       <target dev="tap5de45185-2b"/>
Nov 28 23:00:20 user nova-compute[74959]:     </interface>
Nov 28 23:00:20 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:00:20 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1/console.log" append="off"/>
Nov 28 23:00:20 user nova-compute[74959]:     </serial>
Nov 28 23:00:20 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:00:20 user nova-compute[74959]:     <video>
Nov 28 23:00:20 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:00:20 user nova-compute[74959]:     </video>
Nov 28 23:00:20 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:00:20 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:00:20 user nova-compute[74959]:     </rng>
Nov 28 23:00:20 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:00:20 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:00:20 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:00:20 user nova-compute[74959]:     </memballoon>
Nov 28 23:00:20 user nova-compute[74959]:   </devices>
Nov 28 23:00:20 user nova-compute[74959]: </domain>
Nov 28 23:00:20 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:91:67,bridge_name='br-int',has_traffic_filtering=True,id=9b5b8018-5907-4de7-8843-9486b57ab8e8,network=Network(f307cfd0-85ad-4016-8def-253dbd765bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5b8018-59') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:91:67,bridge_name='br-int',has_traffic_filtering=True,id=9b5b8018-5907-4de7-8843-9486b57ab8e8,network=Network(f307cfd0-85ad-4016-8def-253dbd765bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5b8018-59') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02a839d4-e734-5f3a-920c-fcdcfe5c4826', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b5b8018-59, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b5b8018-59, col_values=(('qos', UUID('f37b8c48-f6ff-47c9-8689-cbb08d8c3c9e')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b5b8018-59, col_values=(('external_ids', {'iface-id': '9b5b8018-5907-4de7-8843-9486b57ab8e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:91:67', 'vm-uuid': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: INFO os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:91:67,bridge_name='br-int',has_traffic_filtering=True,id=9b5b8018-5907-4de7-8843-9486b57ab8e8,network=Network(f307cfd0-85ad-4016-8def-253dbd765bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5b8018-59')
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=9f29a5d6-1528-4d78-a307-071b8f187b89,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f29a5d6-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=9f29a5d6-1528-4d78-a307-071b8f187b89,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f29a5d6-15') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34f2cabc-dd19-5560-a0ec-c7326f06c5c9', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f29a5d6-15, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f29a5d6-15, col_values=(('qos', UUID('68610231-30fc-4ea8-bd90-7bd4cf5942b7')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f29a5d6-15, col_values=(('external_ids', {'iface-id': '9f29a5d6-1528-4d78-a307-071b8f187b89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:bd:15', 'vm-uuid': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: INFO os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=9f29a5d6-1528-4d78-a307-071b8f187b89,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f29a5d6-15')
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:55:5b,bridge_name='br-int',has_traffic_filtering=True,id=77780988-92a8-4524-96bf-e9b8a8420e13,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77780988-92') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:55:5b,bridge_name='br-int',has_traffic_filtering=True,id=77780988-92a8-4524-96bf-e9b8a8420e13,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77780988-92') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83ea6754-676e-5aad-a278-aa7b7782770a', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77780988-92, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77780988-92, col_values=(('qos', UUID('de1abf71-ce76-4aea-8c36-c6b93a1542b6')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77780988-92, col_values=(('external_ids', {'iface-id': '77780988-92a8-4524-96bf-e9b8a8420e13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:55:5b', 'vm-uuid': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: INFO os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:55:5b,bridge_name='br-int',has_traffic_filtering=True,id=77780988-92a8-4524-96bf-e9b8a8420e13,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77780988-92')
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:d0,bridge_name='br-int',has_traffic_filtering=True,id=16be754f-128d-42bb-9e0b-f8109e822537,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16be754f-12') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:d0,bridge_name='br-int',has_traffic_filtering=True,id=16be754f-128d-42bb-9e0b-f8109e822537,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16be754f-12') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3369d39c-c8ce-5357-a108-f84924b10bdb', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16be754f-12, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16be754f-12, col_values=(('qos', UUID('d9af600f-5000-4833-8a51-36cb1a3f4716')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16be754f-12, col_values=(('external_ids', {'iface-id': '16be754f-128d-42bb-9e0b-f8109e822537', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:56:d0', 'vm-uuid': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: INFO os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:d0,bridge_name='br-int',has_traffic_filtering=True,id=16be754f-128d-42bb-9e0b-f8109e822537,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16be754f-12')
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:10:07,bridge_name='br-int',has_traffic_filtering=True,id=ea1a1907-61d6-4b6d-82cf-69c2cf228e37,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1a1907-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:10:07,bridge_name='br-int',has_traffic_filtering=True,id=ea1a1907-61d6-4b6d-82cf-69c2cf228e37,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1a1907-61') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1b29ab4-473d-5dce-b8fd-449850ef27fb', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea1a1907-61, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea1a1907-61, col_values=(('qos', UUID('0f3ac1dc-4081-401e-afd0-3b297bc96d05')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea1a1907-61, col_values=(('external_ids', {'iface-id': 'ea1a1907-61d6-4b6d-82cf-69c2cf228e37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:10:07', 'vm-uuid': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: INFO os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:10:07,bridge_name='br-int',has_traffic_filtering=True,id=ea1a1907-61d6-4b6d-82cf-69c2cf228e37,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1a1907-61')
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:f8,bridge_name='br-int',has_traffic_filtering=True,id=695be666-a837-4bd3-bd97-88e22aeec0db,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695be666-a8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:f8,bridge_name='br-int',has_traffic_filtering=True,id=695be666-a837-4bd3-bd97-88e22aeec0db,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695be666-a8') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e751a15-c5c8-54cf-bd69-3948bd9a9d4e', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap695be666-a8, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap695be666-a8, col_values=(('qos', UUID('964a16b6-904f-45ac-9706-22f4bb371cf5')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap695be666-a8, col_values=(('external_ids', {'iface-id': '695be666-a837-4bd3-bd97-88e22aeec0db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:19:f8', 'vm-uuid': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: INFO os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:f8,bridge_name='br-int',has_traffic_filtering=True,id=695be666-a837-4bd3-bd97-88e22aeec0db,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695be666-a8')
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T22:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=5de45185-2b05-4a71-9c0a-da897f1567a6,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de45185-2b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=5de45185-2b05-4a71-9c0a-da897f1567a6,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de45185-2b') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e62b152f-a382-5424-8b6c-becbf46d1dd6', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5de45185-2b, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5de45185-2b, col_values=(('qos', UUID('6b413dcb-930e-4213-b82f-fa59df9eae11')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5de45185-2b, col_values=(('external_ids', {'iface-id': '5de45185-2b05-4a71-9c0a-da897f1567a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:b1:85', 'vm-uuid': '9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:20 user nova-compute[74959]: INFO os_vif [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=5de45185-2b05-4a71-9c0a-da897f1567a6,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de45185-2b')
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] No BDM found with device name hda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] No VIF found with MAC fa:16:3e:d9:91:67, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:00:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] No VIF found with MAC fa:16:3e:b3:10:07, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:00:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Using config drive
Nov 28 23:00:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Creating config drive at /opt/stack/data/nova/instances/9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1/disk.config
Nov 28 23:00:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmcihsb_u {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmcihsb_u" returned: 0 in 0.059s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-86ea6554-8f59-4840-a199-d3374e982462 req-15fc1f85-0951-4bbd-b812-60140bd90ff1 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-86ea6554-8f59-4840-a199-d3374e982462 req-15fc1f85-0951-4bbd-b812-60140bd90ff1 service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-86ea6554-8f59-4840-a199-d3374e982462 req-15fc1f85-0951-4bbd-b812-60140bd90ff1 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-86ea6554-8f59-4840-a199-d3374e982462 req-15fc1f85-0951-4bbd-b812-60140bd90ff1 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-86ea6554-8f59-4840-a199-d3374e982462 req-15fc1f85-0951-4bbd-b812-60140bd90ff1 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:23 user nova-compute[74959]: WARNING nova.compute.manager [req-86ea6554-8f59-4840-a199-d3374e982462 req-15fc1f85-0951-4bbd-b812-60140bd90ff1 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 for instance with vm_state building and task_state spawning.
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-0896fb6a-ec91-4e26-b9e8-fea81efa698d req-d179b1ee-7948-40c4-996e-c65aca4a1f23 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0896fb6a-ec91-4e26-b9e8-fea81efa698d req-d179b1ee-7948-40c4-996e-c65aca4a1f23 service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0896fb6a-ec91-4e26-b9e8-fea81efa698d req-d179b1ee-7948-40c4-996e-c65aca4a1f23 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0896fb6a-ec91-4e26-b9e8-fea81efa698d req-d179b1ee-7948-40c4-996e-c65aca4a1f23 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-0896fb6a-ec91-4e26-b9e8-fea81efa698d req-d179b1ee-7948-40c4-996e-c65aca4a1f23 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:23 user nova-compute[74959]: WARNING nova.compute.manager [req-0896fb6a-ec91-4e26-b9e8-fea81efa698d req-d179b1ee-7948-40c4-996e-c65aca4a1f23 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 for instance with vm_state building and task_state spawning.
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-e422f2aa-63c9-4485-b995-a2c485dfe2e2 req-ebd12bdc-e18a-46de-93a4-c306b92033a9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e422f2aa-63c9-4485-b995-a2c485dfe2e2 req-ebd12bdc-e18a-46de-93a4-c306b92033a9 service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e422f2aa-63c9-4485-b995-a2c485dfe2e2 req-ebd12bdc-e18a-46de-93a4-c306b92033a9 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e422f2aa-63c9-4485-b995-a2c485dfe2e2 req-ebd12bdc-e18a-46de-93a4-c306b92033a9 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-e422f2aa-63c9-4485-b995-a2c485dfe2e2 req-ebd12bdc-e18a-46de-93a4-c306b92033a9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:24 user nova-compute[74959]: WARNING nova.compute.manager [req-e422f2aa-63c9-4485-b995-a2c485dfe2e2 req-ebd12bdc-e18a-46de-93a4-c306b92033a9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 for instance with vm_state building and task_state spawning.
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-029f292f-5967-4a19-9023-0948c89096a4 req-5eccfa91-44ce-493e-94b3-2eaadc3021cf service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:25 user nova-compute[74959]: WARNING nova.compute.manager [req-d0ee8b39-7f77-4b4a-ad86-15961cb4e372 req-47016e8a-96f8-4e15-ad80-c02cb4af03ba service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 for instance with vm_state building and task_state spawning.
Nov 28 23:00:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-114e6dbc-00d5-42c0-98d3-d0c8b0e970fe req-870999f8-cab3-47c5-be87-212afd036805 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-114e6dbc-00d5-42c0-98d3-d0c8b0e970fe req-870999f8-cab3-47c5-be87-212afd036805 service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-114e6dbc-00d5-42c0-98d3-d0c8b0e970fe req-870999f8-cab3-47c5-be87-212afd036805 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-114e6dbc-00d5-42c0-98d3-d0c8b0e970fe req-870999f8-cab3-47c5-be87-212afd036805 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-114e6dbc-00d5-42c0-98d3-d0c8b0e970fe req-870999f8-cab3-47c5-be87-212afd036805 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:26 user nova-compute[74959]: WARNING nova.compute.manager [req-114e6dbc-00d5-42c0-98d3-d0c8b0e970fe req-870999f8-cab3-47c5-be87-212afd036805 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 for instance with vm_state building and task_state spawning.
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:00:26 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance spawned successfully.
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:00:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:00:27 user nova-compute[74959]: INFO nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Took 11.90 seconds to spawn the instance on the hypervisor.
Nov 28 23:00:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:00:27 user nova-compute[74959]: INFO nova.compute.manager [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Took 35.79 seconds to build instance.
Nov 28 23:00:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-09c3fcf6-10f5-4da9-af9f-ac856565c367 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.917s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:00:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:32 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:00:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:00:33 user nova-compute[74959]: INFO nova.compute.manager [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] instance snapshotting
Nov 28 23:00:33 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Beginning live snapshot process
Nov 28 23:00:33 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Updating instance_info_cache with network_info: [{"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-3e471897-443d-4b80-b60a-dad06cbe21f9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:00:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json -f qcow2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json -f qcow2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkdwurhkh/fd582127e7b14eddb45131815a8a711c.delta 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkdwurhkh/fd582127e7b14eddb45131815a8a711c.delta 1073741824" returned: 0 in 0.053s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 23:00:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74959) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 23:00:34 user nova-compute[74959]: INFO nova.virt.libvirt.host [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] UEFI support detected
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG nova.objects.instance [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lazy-loading 'flavor' on Instance uuid 3e471897-443d-4b80-b60a-dad06cbe21f9 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:34 user nova-compute[74959]: INFO nova.compute.manager [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Attaching volume 8540dec0-1f2b-4c4f-988a-948ecb1b1f44 to /dev/vdb
Nov 28 23:00:34 user nova-compute[74959]: DEBUG os_brick.utils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[14729f5c-549f-4a38-80b9-849bda3da5e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9c3507-9e3a-4ee3-80bd-878751fc16c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8b345c-4a85-45dd-a6de-5ab24e871bbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[78570159-9844-46ed-9dd4-fa30d8a16114]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:34 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:00:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d264608f-7a58-4b2f-ba0f-6bbf8a7c6593]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG os_brick.utils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:34 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Updating existing volume attachment record: effcfa3d-a845-4be6-b402-3565b8be7413 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:00:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] COPY block job progress, current cursor: 589824 final cursor: 75497472 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:00:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:00:35 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 23:00:35 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:00:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkdwurhkh/fd582127e7b14eddb45131815a8a711c.delta /opt/stack/data/nova/instances/snapshots/tmpkdwurhkh/fd582127e7b14eddb45131815a8a711c {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkdwurhkh/fd582127e7b14eddb45131815a8a711c.delta /opt/stack/data/nova/instances/snapshots/tmpkdwurhkh/fd582127e7b14eddb45131815a8a711c" returned: 0 in 0.571s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Snapshot extracted, beginning image upload
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-867c91cb-941c-42bf-bf49-5e7fc2773c92 req-4f39651d-b21a-4fdd-89a3-bb92c2179e83 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received event network-changed-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-867c91cb-941c-42bf-bf49-5e7fc2773c92 req-4f39651d-b21a-4fdd-89a3-bb92c2179e83 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Refreshing instance network info cache due to event network-changed-cf3e934b-c8e7-4432-ae58-fe4282d0d384. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-867c91cb-941c-42bf-bf49-5e7fc2773c92 req-4f39651d-b21a-4fdd-89a3-bb92c2179e83 service nova] Acquiring lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-867c91cb-941c-42bf-bf49-5e7fc2773c92 req-4f39651d-b21a-4fdd-89a3-bb92c2179e83 service nova] Acquired lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-867c91cb-941c-42bf-bf49-5e7fc2773c92 req-4f39651d-b21a-4fdd-89a3-bb92c2179e83 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Refreshing network info cache for port cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:39 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Snapshot image upload complete
Nov 28 23:00:39 user nova-compute[74959]: INFO nova.compute.manager [None req-b1d9972b-fda5-4944-92ad-515fa72e7b43 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Took 6.07 seconds to snapshot the instance on the hypervisor.
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-f7bb77ea-134e-497b-9cfb-c84a538bf7c4 req-bd976cd5-cfda-4535-be00-e72341de9439 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-changed-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-f7bb77ea-134e-497b-9cfb-c84a538bf7c4 req-bd976cd5-cfda-4535-be00-e72341de9439 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Refreshing instance network info cache due to event network-changed-c60abc7f-b5c7-45ef-a218-d7454c7dbff8. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f7bb77ea-134e-497b-9cfb-c84a538bf7c4 req-bd976cd5-cfda-4535-be00-e72341de9439 service nova] Acquiring lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f7bb77ea-134e-497b-9cfb-c84a538bf7c4 req-bd976cd5-cfda-4535-be00-e72341de9439 service nova] Acquired lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-f7bb77ea-134e-497b-9cfb-c84a538bf7c4 req-bd976cd5-cfda-4535-be00-e72341de9439 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Refreshing network info cache for port c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG nova.network.neutron [req-f7bb77ea-134e-497b-9cfb-c84a538bf7c4 req-bd976cd5-cfda-4535-be00-e72341de9439 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updated VIF entry in instance network info cache for port c60abc7f-b5c7-45ef-a218-d7454c7dbff8. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG nova.network.neutron [req-f7bb77ea-134e-497b-9cfb-c84a538bf7c4 req-bd976cd5-cfda-4535-be00-e72341de9439 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f7bb77ea-134e-497b-9cfb-c84a538bf7c4 req-bd976cd5-cfda-4535-be00-e72341de9439 service nova] Releasing lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG nova.network.neutron [req-867c91cb-941c-42bf-bf49-5e7fc2773c92 req-4f39651d-b21a-4fdd-89a3-bb92c2179e83 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updated VIF entry in instance network info cache for port cf3e934b-c8e7-4432-ae58-fe4282d0d384. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG nova.network.neutron [req-867c91cb-941c-42bf-bf49-5e7fc2773c92 req-4f39651d-b21a-4fdd-89a3-bb92c2179e83 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updating instance_info_cache with network_info: [{"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-867c91cb-941c-42bf-bf49-5e7fc2773c92 req-4f39651d-b21a-4fdd-89a3-bb92c2179e83 service nova] Releasing lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-a117f7ad-8d44-4644-a33d-8e64b40893f2 req-115f13bc-acca-4a27-96da-267e1988d7bd service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-changed-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-a117f7ad-8d44-4644-a33d-8e64b40893f2 req-115f13bc-acca-4a27-96da-267e1988d7bd service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Refreshing instance network info cache due to event network-changed-67663953-c88b-4b51-88e5-2904a213a0ef. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a117f7ad-8d44-4644-a33d-8e64b40893f2 req-115f13bc-acca-4a27-96da-267e1988d7bd service nova] Acquiring lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a117f7ad-8d44-4644-a33d-8e64b40893f2 req-115f13bc-acca-4a27-96da-267e1988d7bd service nova] Acquired lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG nova.network.neutron [req-a117f7ad-8d44-4644-a33d-8e64b40893f2 req-115f13bc-acca-4a27-96da-267e1988d7bd service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Refreshing network info cache for port 67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2242ad4-c680-4dec-b4b0-bdf8e2335977 req-149eaf20-6493-41e4-b15c-f334fbf39d66 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-changed-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2242ad4-c680-4dec-b4b0-bdf8e2335977 req-149eaf20-6493-41e4-b15c-f334fbf39d66 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Refreshing instance network info cache due to event network-changed-ded8a2c4-07d6-440e-9110-4c2a7b2738f2. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2242ad4-c680-4dec-b4b0-bdf8e2335977 req-149eaf20-6493-41e4-b15c-f334fbf39d66 service nova] Acquiring lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2242ad4-c680-4dec-b4b0-bdf8e2335977 req-149eaf20-6493-41e4-b15c-f334fbf39d66 service nova] Acquired lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG nova.network.neutron [req-b2242ad4-c680-4dec-b4b0-bdf8e2335977 req-149eaf20-6493-41e4-b15c-f334fbf39d66 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Refreshing network info cache for port ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG nova.network.neutron [req-a117f7ad-8d44-4644-a33d-8e64b40893f2 req-115f13bc-acca-4a27-96da-267e1988d7bd service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updated VIF entry in instance network info cache for port 67663953-c88b-4b51-88e5-2904a213a0ef. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:41 user nova-compute[74959]: DEBUG nova.network.neutron [req-a117f7ad-8d44-4644-a33d-8e64b40893f2 req-115f13bc-acca-4a27-96da-267e1988d7bd service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:00:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=6710MB free_disk=25.457469940185547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a117f7ad-8d44-4644-a33d-8e64b40893f2 req-115f13bc-acca-4a27-96da-267e1988d7bd service nova] Releasing lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 3e471897-443d-4b80-b60a-dad06cbe21f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 94b085b2-b298-4780-be94-21f85c799945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d339c51b-2c03-4ac9-800f-b5dc053e0585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 17495411-b15b-4660-b2fe-42749b11ed49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6c504232-f516-4764-8df1-7bff0a3bd413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d0d20108-9362-4586-9d9d-88522ce58ad7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.network.neutron [req-b2242ad4-c680-4dec-b4b0-bdf8e2335977 req-149eaf20-6493-41e4-b15c-f334fbf39d66 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updated VIF entry in instance network info cache for port ded8a2c4-07d6-440e-9110-4c2a7b2738f2. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.network.neutron [req-b2242ad4-c680-4dec-b4b0-bdf8e2335977 req-149eaf20-6493-41e4-b15c-f334fbf39d66 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2242ad4-c680-4dec-b4b0-bdf8e2335977 req-149eaf20-6493-41e4-b15c-f334fbf39d66 service nova] Releasing lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:00:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:43 user nova-compute[74959]: INFO nova.compute.manager [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Shelving
Nov 28 23:00:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-c7b5f256-9530-4065-b790-8f635240e208 req-55fb8eb5-d474-4919-a8f8-f054d93a9722 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-vif-unplugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c7b5f256-9530-4065-b790-8f635240e208 req-55fb8eb5-d474-4919-a8f8-f054d93a9722 service nova] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c7b5f256-9530-4065-b790-8f635240e208 req-55fb8eb5-d474-4919-a8f8-f054d93a9722 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c7b5f256-9530-4065-b790-8f635240e208 req-55fb8eb5-d474-4919-a8f8-f054d93a9722 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-c7b5f256-9530-4065-b790-8f635240e208 req-55fb8eb5-d474-4919-a8f8-f054d93a9722 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] No waiting events found dispatching network-vif-unplugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:43 user nova-compute[74959]: WARNING nova.compute.manager [req-c7b5f256-9530-4065-b790-8f635240e208 req-55fb8eb5-d474-4919-a8f8-f054d93a9722 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received unexpected event network-vif-unplugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 for instance with vm_state active and task_state shelving.
Nov 28 23:00:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:44 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance destroyed successfully.
Nov 28 23:00:44 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Beginning cold snapshot process
Nov 28 23:00:44 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:00:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk /opt/stack/data/nova/instances/snapshots/tmpf2h0vsuh/8cc483f749fb47b3a7d908e82a4c43c7 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:00:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvzcTyAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:44 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:45 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:45 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9704f0-bef4-4552-8ceb-0f25b1cb04b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:00:45 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[47970ad7-983e-4852-938e-404c23150be8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44] added
Nov 28 23:00:45 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fb8d82-c68a-4a42-9367-b6a420d24e96]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b303d9e-329a-4ef7-a5d0-70522e21053c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvzcTyAN {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvzcTyAN" returned: 0 in 0.072s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1e6ef3-d2a7-45c2-9e9e-f8485aed2d76]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QvzcTyAN'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.082s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[760c63f7-9686-4507-8637-4e6d07f4836e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39d2cb6-7f0a-49bb-af9b-691faf9da39d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:00:45 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:00:45 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4eaff-b771-4c7c-bf8a-0bc67987d516]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44, portal: 172.16.0.220,3260]
Nov 28 23:00:45 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44, portal: 172.16.0.220,3260] successful.
Nov 28 23:00:45 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.079s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe54561-6c82-467b-b2b0-e847e4e08ed5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk /opt/stack/data/nova/instances/snapshots/tmpf2h0vsuh/8cc483f749fb47b3a7d908e82a4c43c7" returned: 0 in 1.168s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Snapshot extracted, beginning image upload
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG nova.objects.instance [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b38f36-964e-4d11-bd63-be362c3ab22c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG nova.objects.instance [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:00:45 user nova-compute[74959]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 (non-flash)
Nov 28 23:00:45 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.828s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fff9c8-5796-4bad-8852-d5da9b379688]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-a449c040-3e3e-4a46-b46c-d597a21785f0 req-4962fd4d-5255-40ec-bde0-ea7074c8c088 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a449c040-3e3e-4a46-b46c-d597a21785f0 req-4962fd4d-5255-40ec-bde0-ea7074c8c088 service nova] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a449c040-3e3e-4a46-b46c-d597a21785f0 req-4962fd4d-5255-40ec-bde0-ea7074c8c088 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a449c040-3e3e-4a46-b46c-d597a21785f0 req-4962fd4d-5255-40ec-bde0-ea7074c8c088 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-a449c040-3e3e-4a46-b46c-d597a21785f0 req-4962fd4d-5255-40ec-bde0-ea7074c8c088 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] No waiting events found dispatching network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:45 user nova-compute[74959]: WARNING nova.compute.manager [req-a449c040-3e3e-4a46-b46c-d597a21785f0 req-4962fd4d-5255-40ec-bde0-ea7074c8c088 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received unexpected event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:46 user nova-compute[74959]: INFO nova.compute.manager [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Attaching volume 9541c8fb-4ccf-4814-9d42-d778e411bf8f to /dev/vdb
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:46 user nova-compute[74959]: INFO nova.compute.manager [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Attaching volume f4f19256-661e-4d78-bfb7-ed5e50539ebf to /dev/vdb
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08b4a78-b69e-480f-8471-a2e969215ac9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21c6c8b-83eb-4a10-8365-45ac69416b70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea862e-3848-4834-8573-07b59727b6af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d835a-9819-4eea-8d26-0424049cf68e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e98b6c-90a2-443f-bcee-2e1f84966600]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20534d3-4565-4a18-9867-b2f07e91a28c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6f3997-72a3-4677-8ca5-167138ca5e03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a6ec8a-c7b0-4e98-a71d-6341d59b1324]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:46 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e277901-1529-44b8-b8a9-7679192b9ccb]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updating existing volume attachment record: 6647fd15-6064-4e8b-8b72-bb81e4ef2aa0 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:00:46 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:00:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe80c8-672a-4cd9-9901-d7f88899c0dd]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating existing volume attachment record: 50b3aabf-579f-49cc-a37f-774a94441d56 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvzcTyAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.864s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] <== connect_volume: return (1866ms) {'type': 'block', 'scsi_wwn': '26533356662666161', 'path': '/dev/sde'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533356662666161', 'path': '/dev/sde'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG nova.objects.instance [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lazy-loading 'flavor' on Instance uuid 3e471897-443d-4b80-b60a-dad06cbe21f9 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:00:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:00:46 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:00:46 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:00:46 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:00:46 user nova-compute[74959]:   <serial>8540dec0-1f2b-4c4f-988a-948ecb1b1f44</serial>
Nov 28 23:00:46 user nova-compute[74959]: </disk>
Nov 28 23:00:46 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] No VIF found with MAC fa:16:3e:0d:22:16, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14ca263a-4740-4b74-ac41-6574e1b43ada tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.873s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:47 user nova-compute[74959]: INFO nova.compute.manager [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Terminating instance
Nov 28 23:00:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-6613bdea-2bbd-49f4-8edc-c1f1bf3f327a req-682ad31c-d9ec-4d36-a9c1-082d5881da2c service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received event network-vif-unplugged-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6613bdea-2bbd-49f4-8edc-c1f1bf3f327a req-682ad31c-d9ec-4d36-a9c1-082d5881da2c service nova] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6613bdea-2bbd-49f4-8edc-c1f1bf3f327a req-682ad31c-d9ec-4d36-a9c1-082d5881da2c service nova] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6613bdea-2bbd-49f4-8edc-c1f1bf3f327a req-682ad31c-d9ec-4d36-a9c1-082d5881da2c service nova] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-6613bdea-2bbd-49f4-8edc-c1f1bf3f327a req-682ad31c-d9ec-4d36-a9c1-082d5881da2c service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] No waiting events found dispatching network-vif-unplugged-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-6613bdea-2bbd-49f4-8edc-c1f1bf3f327a req-682ad31c-d9ec-4d36-a9c1-082d5881da2c service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received event network-vif-unplugged-1b305c28-4e54-427a-95d7-e94f18e768c7 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:00:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Instance destroyed successfully.
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lazy-loading 'resources' on Instance uuid 3e471897-443d-4b80-b60a-dad06cbe21f9 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-582890100',display_name='tempest-DeleteServersTestJSON-server-582890100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-582890100',id=2,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c19211f3f50842619c64ccda7af2187f',ramdisk_id='',reservation_id='r-44s06uia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-146052557',owner_user_name='tempest-DeleteServersTestJSON-146052557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:02Z,user_data=None,user_id='319383d7dcac476fbe51683e055a5cda',uuid=3e471897-443d-4b80-b60a-dad06cbe21f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Converting VIF {"id": "1b305c28-4e54-427a-95d7-e94f18e768c7", "address": "fa:16:3e:0d:22:16", "network": {"id": "3f4c6bd1-9d5c-469c-a484-9f06a1b9b036", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878516899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19211f3f50842619c64ccda7af2187f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b305c28-4e", "ovs_interfaceid": "1b305c28-4e54-427a-95d7-e94f18e768c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:22:16,bridge_name='br-int',has_traffic_filtering=True,id=1b305c28-4e54-427a-95d7-e94f18e768c7,network=Network(3f4c6bd1-9d5c-469c-a484-9f06a1b9b036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b305c28-4e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_vif [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:22:16,bridge_name='br-int',has_traffic_filtering=True,id=1b305c28-4e54-427a-95d7-e94f18e768c7,network=Network(3f4c6bd1-9d5c-469c-a484-9f06a1b9b036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b305c28-4e') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b305c28-4e, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0048fa9d-4b74-4f5e-92c7-196858af676a) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:48 user nova-compute[74959]: INFO os_vif [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:22:16,bridge_name='br-int',has_traffic_filtering=True,id=1b305c28-4e54-427a-95d7-e94f18e768c7,network=Network(3f4c6bd1-9d5c-469c-a484-9f06a1b9b036),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b305c28-4e')
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvzcTyAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:00:48 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Snapshot image upload complete
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a8ffe8-993b-4a5e-a33d-b2f8466bb2e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:00:48 user nova-compute[74959]: No targets found.
Nov 28 23:00:48 user nova-compute[74959]: iSNS:
Nov 28 23:00:48 user nova-compute[74959]: No targets found.
Nov 28 23:00:48 user nova-compute[74959]: STATIC:
Nov 28 23:00:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44
Nov 28 23:00:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:00:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:00:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c
Nov 28 23:00:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:00:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:00:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6
Nov 28 23:00:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:00:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:00:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441
Nov 28 23:00:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:00:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:00:48 user nova-compute[74959]: FIRMWARE:
Nov 28 23:00:48 user nova-compute[74959]: No targets found.
Nov 28 23:00:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:00:48 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:00:48 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb9c66d-5b84-4bee-a63d-b0c58aa7d3a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc703773-0976-4858-a987-d5a86be05a8f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:48 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:48 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:00:48 user nova-compute[74959]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 (non-flash)
Nov 28 23:00:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:00:48 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:00:48 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:00:48 user nova-compute[74959]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 (non-flash)
Nov 28 23:00:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef49069e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44'): ({'sde'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Removing single pathed devices sde {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:48 user nova-compute[74959]: INFO nova.compute.manager [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Shelve offloading
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c39b0-4ce2-4b9e-a53f-b97b09910bc5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance destroyed successfully.
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquired lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f91a300-be0b-4049-b4c4-698efd581522]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Flushing IO for device /dev/sde {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[473c7b35-ea61-4bdc-8372-d60c5308df75]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b944466-cc20-41f6-a1e4-c5de32de566b]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:00:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4955b35c-d4c0-494e-bed5-62886db52d47]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e393fbc-3e17-4fc0-8d9e-2c284082a567]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44, portal: 172.16.0.220,3260]
Nov 28 23:00:49 user nova-compute[74959]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44, portal: 172.16.0.220,3260] successful.
Nov 28 23:00:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540dec0-1f2b-4c4f-988a-948ecb1b1f44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac488fd-e359-412c-a81e-96e16c1c8fdb]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] <== disconnect_volume: return (317ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:00:49 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Deleting instance files /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9_del
Nov 28 23:00:49 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Deletion of /opt/stack/data/nova/instances/3e471897-443d-4b80-b60a-dad06cbe21f9_del complete
Nov 28 23:00:49 user nova-compute[74959]: INFO nova.compute.manager [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG nova.network.neutron [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Releasing lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:49 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:49 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Took 0.66 seconds to deallocate network for instance.
Nov 28 23:00:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance destroyed successfully.
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.objects.instance [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'resources' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1352161345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1352161345',id=5,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY4MPQnR0dTjucVmfRDrhSYKQ3fqU/FWP4ALTGw8zlVLwL32IGrGCUHF6lce73hXDH8jVHMwOZD1NSRvG/cdfElX8l2fYUZVksr8R+lEHe8XLHTG3jfGiDtzbAS3EBOcA==',key_name='tempest-keypair-271008495',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-oyejk6uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member',shelved_at='2023-11-28T23:00:48.813819',shelved_host='user',shelved_image_id='81a9501c-45c7-4462-be38-f8059cd98767'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=94b085b2-b298-4780-be94-21f85c799945,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG os_vif [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-31e11613-6f9a-447a-b2ea-e164a58efa2c req-1605dd86-e2e9-4bb4-b89a-540e280b03a9 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-changed-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-31e11613-6f9a-447a-b2ea-e164a58efa2c req-1605dd86-e2e9-4bb4-b89a-540e280b03a9 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Refreshing instance network info cache due to event network-changed-c60abc7f-b5c7-45ef-a218-d7454c7dbff8. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-31e11613-6f9a-447a-b2ea-e164a58efa2c req-1605dd86-e2e9-4bb4-b89a-540e280b03a9 service nova] Acquiring lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-31e11613-6f9a-447a-b2ea-e164a58efa2c req-1605dd86-e2e9-4bb4-b89a-540e280b03a9 service nova] Acquired lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.network.neutron [req-31e11613-6f9a-447a-b2ea-e164a58efa2c req-1605dd86-e2e9-4bb4-b89a-540e280b03a9 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Refreshing network info cache for port c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc60abc7f-b5, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70100ade-f2c6-45c5-a170-2a22598991e7) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:50 user nova-compute[74959]: INFO os_vif [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5')
Nov 28 23:00:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Deleting instance files /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945_del
Nov 28 23:00:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Deletion of /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945_del complete
Nov 28 23:00:50 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Deleted allocations for instance 94b085b2-b298-4780-be94-21f85c799945
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.objects.instance [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'numa_topology' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.objects.base [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<94b085b2-b298-4780-be94-21f85c799945> lazy-loaded attributes: resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-5bd08c8b-cd45-4e3d-83ed-d9812d39e0b2 req-fe50fbd0-cc1c-457d-acf9-4d8a8987aaff service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received event network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5bd08c8b-cd45-4e3d-83ed-d9812d39e0b2 req-fe50fbd0-cc1c-457d-acf9-4d8a8987aaff service nova] Acquiring lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5bd08c8b-cd45-4e3d-83ed-d9812d39e0b2 req-fe50fbd0-cc1c-457d-acf9-4d8a8987aaff service nova] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5bd08c8b-cd45-4e3d-83ed-d9812d39e0b2 req-fe50fbd0-cc1c-457d-acf9-4d8a8987aaff service nova] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-5bd08c8b-cd45-4e3d-83ed-d9812d39e0b2 req-fe50fbd0-cc1c-457d-acf9-4d8a8987aaff service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] No waiting events found dispatching network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:00:50 user nova-compute[74959]: WARNING nova.compute.manager [req-5bd08c8b-cd45-4e3d-83ed-d9812d39e0b2 req-fe50fbd0-cc1c-457d-acf9-4d8a8987aaff service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received unexpected event network-vif-plugged-1b305c28-4e54-427a-95d7-e94f18e768c7 for instance with vm_state active and task_state deleting.
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-5bd08c8b-cd45-4e3d-83ed-d9812d39e0b2 req-fe50fbd0-cc1c-457d-acf9-4d8a8987aaff service nova] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Received event network-vif-deleted-1b305c28-4e54-427a-95d7-e94f18e768c7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.network.neutron [req-31e11613-6f9a-447a-b2ea-e164a58efa2c req-1605dd86-e2e9-4bb4-b89a-540e280b03a9 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updated VIF entry in instance network info cache for port c60abc7f-b5c7-45ef-a218-d7454c7dbff8. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.network.neutron [req-31e11613-6f9a-447a-b2ea-e164a58efa2c req-1605dd86-e2e9-4bb4-b89a-540e280b03a9 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-31e11613-6f9a-447a-b2ea-e164a58efa2c req-1605dd86-e2e9-4bb4-b89a-540e280b03a9 service nova] Releasing lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:50 user nova-compute[74959]: INFO nova.compute.manager [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] [instance: 3e471897-443d-4b80-b60a-dad06cbe21f9] Took 0.84 seconds to detach 1 volumes for instance.
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f204a4-a4d4-4850-966f-3bb65056566d tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.168s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:00:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:00:51 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:00:51 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:00:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:51 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Deleted allocations for instance 3e471897-443d-4b80-b60a-dad06cbe21f9
Nov 28 23:00:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3af7bdd4-50d9-4f6e-80d4-0116d74eae54 tempest-DeleteServersTestJSON-146052557 tempest-DeleteServersTestJSON-146052557-project-member] Lock "3e471897-443d-4b80-b60a-dad06cbe21f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.346s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:00:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:00:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-2e00d18e-f0a4-4209-97aa-b80fbcd85e18 req-86d539a0-36eb-48a0-97d1-8fcef91143fb service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received event network-changed-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:00:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-2e00d18e-f0a4-4209-97aa-b80fbcd85e18 req-86d539a0-36eb-48a0-97d1-8fcef91143fb service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Refreshing instance network info cache due to event network-changed-62a02076-f272-41c6-aa3a-f49c904dfa68. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:00:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e00d18e-f0a4-4209-97aa-b80fbcd85e18 req-86d539a0-36eb-48a0-97d1-8fcef91143fb service nova] Acquiring lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:00:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e00d18e-f0a4-4209-97aa-b80fbcd85e18 req-86d539a0-36eb-48a0-97d1-8fcef91143fb service nova] Acquired lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:00:57 user nova-compute[74959]: DEBUG nova.network.neutron [req-2e00d18e-f0a4-4209-97aa-b80fbcd85e18 req-86d539a0-36eb-48a0-97d1-8fcef91143fb service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Refreshing network info cache for port 62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:00:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-2e00d18e-f0a4-4209-97aa-b80fbcd85e18 req-86d539a0-36eb-48a0-97d1-8fcef91143fb service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Updated VIF entry in instance network info cache for port 62a02076-f272-41c6-aa3a-f49c904dfa68. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:00:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-2e00d18e-f0a4-4209-97aa-b80fbcd85e18 req-86d539a0-36eb-48a0-97d1-8fcef91143fb service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Updating instance_info_cache with network_info: [{"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:00:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e00d18e-f0a4-4209-97aa-b80fbcd85e18 req-86d539a0-36eb-48a0-97d1-8fcef91143fb service nova] Releasing lock "refresh_cache-d339c51b-2c03-4ac9-800f-b5dc053e0585" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsPoIUeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:00 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba08ef5-c58c-4275-8296-b4f990e860c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:00 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEdzSqcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dff158d-60ff-48dc-8c46-3e46f7c66b14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf] added
Nov 28 23:01:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13ff4cb-a230-4b1a-ad4f-5c23d47ed83a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lazy-loading 'flavor' on Instance uuid d339c51b-2c03-4ac9-800f-b5dc053e0585 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.101s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2fd290-af45-4cc4-b448-89f2bd811394]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsPoIUeG {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsPoIUeG" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41982fe-c488-45d7-a5d1-3ccafb5a379c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CsPoIUeG'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5720ada-369f-43f7-95ab-6d520a9fff76]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b68a7d5-e454-44a9-b98e-1e29e74095a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b789fac-1bb1-483b-90a6-ceb714fd76db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260]
Nov 28 23:01:00 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:00 user nova-compute[74959]: INFO nova.compute.manager [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Attaching volume aa49697e-f7ba-4e00-a3ce-e080f008ac85 to /dev/vdb
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e98026a-52e6-4650-8db7-40b7c1b17b2c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c3d85a-426e-4b82-8283-234d6f717fe1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:00 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd2d9d9-7392-4450-a53d-8fff9ae2ecb0]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsPoIUeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.utils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4211ba21-b4cc-4834-b769-48c55275e0a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-a89b5cc7-eb84-4676-811e-7bdeb632c059 req-ab401ffe-2529-4194-adcd-549ff2de2112 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received event network-changed-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-a89b5cc7-eb84-4676-811e-7bdeb632c059 req-ab401ffe-2529-4194-adcd-549ff2de2112 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Refreshing instance network info cache due to event network-changed-2b663438-3f9d-4bbf-aabf-e321f898662d. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a89b5cc7-eb84-4676-811e-7bdeb632c059 req-ab401ffe-2529-4194-adcd-549ff2de2112 service nova] Acquiring lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a89b5cc7-eb84-4676-811e-7bdeb632c059 req-ab401ffe-2529-4194-adcd-549ff2de2112 service nova] Acquired lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG nova.network.neutron [req-a89b5cc7-eb84-4676-811e-7bdeb632c059 req-ab401ffe-2529-4194-adcd-549ff2de2112 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Refreshing network info cache for port 2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b1aa78-28f8-4d65-bfc4-a66cdc824bd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff0417-64f4-431d-8dc1-1ecaa3f908f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[929ad682-dc4e-42d2-bb02-f40a2138c3fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:01 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9573009-d463-4240-bf8a-d5f67030d8b2]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG os_brick.utils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Updating existing volume attachment record: 78910516-f3fc-44f6-a3ac-919c50272290 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG nova.network.neutron [req-a89b5cc7-eb84-4676-811e-7bdeb632c059 req-ab401ffe-2529-4194-adcd-549ff2de2112 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Updated VIF entry in instance network info cache for port 2b663438-3f9d-4bbf-aabf-e321f898662d. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG nova.network.neutron [req-a89b5cc7-eb84-4676-811e-7bdeb632c059 req-ab401ffe-2529-4194-adcd-549ff2de2112 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Updating instance_info_cache with network_info: [{"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a89b5cc7-eb84-4676-811e-7bdeb632c059 req-ab401ffe-2529-4194-adcd-549ff2de2112 service nova] Releasing lock "refresh_cache-17495411-b15b-4660-b2fe-42749b11ed49" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23566336237643063', 'path': '/dev/sde'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566336237643063', 'path': '/dev/sde'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.362s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:02 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:02 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef828588-c35a-48e4-b986-13bbe24595d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:02 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:01:02 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:02 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:01:02 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:02 user nova-compute[74959]:   <serial>f4f19256-661e-4d78-bfb7-ed5e50539ebf</serial>
Nov 28 23:01:02 user nova-compute[74959]: </disk>
Nov 28 23:01:02 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ca2c0d-393f-4e18-94dc-0a7b0948e74a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f] added
Nov 28 23:01:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3170585-a2eb-4d00-958c-d4d9ac847ee9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[546aa2f0-8b40-4179-8771-75afb74b1614]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEdzSqcU {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-d79f065d-233d-4898-a7fa-1ddfe34dbe4c req-268b84d8-0b2f-4cf9-9ce2-4de56c821201 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-changed-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-d79f065d-233d-4898-a7fa-1ddfe34dbe4c req-268b84d8-0b2f-4cf9-9ce2-4de56c821201 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Refreshing instance network info cache due to event network-changed-c3f3885d-8bb2-465b-a52f-b9ee64375c47. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d79f065d-233d-4898-a7fa-1ddfe34dbe4c req-268b84d8-0b2f-4cf9-9ce2-4de56c821201 service nova] Acquiring lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d79f065d-233d-4898-a7fa-1ddfe34dbe4c req-268b84d8-0b2f-4cf9-9ce2-4de56c821201 service nova] Acquired lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-d79f065d-233d-4898-a7fa-1ddfe34dbe4c req-268b84d8-0b2f-4cf9-9ce2-4de56c821201 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Refreshing network info cache for port c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEdzSqcU" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b10a929-5e87-436b-8322-1d5114a4ff4d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEdzSqcU'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e76b1d-b92b-49b3-995f-fa1770226316]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd752627-5c82-4901-91de-54b7a8a9161d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7f779-fc6a-48e0-a923-ab358b29ab6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f, portal: 172.16.0.220,3260]
Nov 28 23:01:02 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d27d3c-0e4f-4c58-8d45-74827d84b949]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1826524-0f15-4295-9bb1-503020339105]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:02 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58cd1f0-cd0e-4d1c-bbde-c30ffbbe5d36]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEdzSqcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No VIF found with MAC fa:16:3e:69:f4:ad, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "interface-6c504232-f516-4764-8df1-7bff0a3bd413-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "interface-6c504232-f516-4764-8df1-7bff0a3bd413-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lazy-loading 'flavor' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-78615ff1-d3c6-4d1c-92b0-9d9eb921b351 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.566s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lazy-loading 'pci_requests' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.objects.base [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Object Instance<6c504232-f516-4764-8df1-7bff0a3bd413> lazy-loaded attributes: flavor,pci_requests {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-d79f065d-233d-4898-a7fa-1ddfe34dbe4c req-268b84d8-0b2f-4cf9-9ce2-4de56c821201 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updated VIF entry in instance network info cache for port c3f3885d-8bb2-465b-a52f-b9ee64375c47. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-d79f065d-233d-4898-a7fa-1ddfe34dbe4c req-268b84d8-0b2f-4cf9-9ce2-4de56c821201 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d79f065d-233d-4898-a7fa-1ddfe34dbe4c req-268b84d8-0b2f-4cf9-9ce2-4de56c821201 service nova] Releasing lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7bc93a86-d163-4281-9762-57a2b9cf1be4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7bc93a86-d163-4281-9762-57a2b9cf1be4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7bc93a86-d163-4281-9762-57a2b9cf1be4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.policy [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ee17e5f07f04b31b55b3fa94c8cf8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c3efd63364440eb53df04de34a01bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7bc93a86-d163-4281-9762-57a2b9cf1be4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74959) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 23:01:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-7bc93a86-d163-4281-9762-57a2b9cf1be4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-41cdfdea-cb6c-4adc-b657-59213daf5dc1 req-553d4afc-5246-4123-850d-d714b5e8ce48 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-41cdfdea-cb6c-4adc-b657-59213daf5dc1 req-553d4afc-5246-4123-850d-d714b5e8ce48 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-41cdfdea-cb6c-4adc-b657-59213daf5dc1 req-553d4afc-5246-4123-850d-d714b5e8ce48 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-41cdfdea-cb6c-4adc-b657-59213daf5dc1 req-553d4afc-5246-4123-850d-d714b5e8ce48 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-41cdfdea-cb6c-4adc-b657-59213daf5dc1 req-553d4afc-5246-4123-850d-d714b5e8ce48 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:03 user nova-compute[74959]: WARNING nova.compute.manager [req-41cdfdea-cb6c-4adc-b657-59213daf5dc1 req-553d4afc-5246-4123-850d-d714b5e8ce48 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state active and task_state powering-off.
Nov 28 23:01:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== connect_volume: return (2716ms) {'type': 'block', 'scsi_wwn': '26565616432313039', 'path': '/dev/sdf'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565616432313039', 'path': '/dev/sdf'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG nova.objects.instance [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:01:03 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:03 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:01:03 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:03 user nova-compute[74959]:   <serial>9541c8fb-4ccf-4814-9d42-d778e411bf8f</serial>
Nov 28 23:01:03 user nova-compute[74959]: </disk>
Nov 28 23:01:03 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG nova.network.neutron [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Successfully created port: f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:01:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance destroyed successfully.
Nov 28 23:01:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7bc93a86-d163-4281-9762-57a2b9cf1be4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No VIF found with MAC fa:16:3e:d7:b0:e5, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7bc93a86-d163-4281-9762-57a2b9cf1be4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.220s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-92e0d062-a77f-4f68-8963-895683f2acb3 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.223s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG nova.network.neutron [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Successfully updated port: f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquired lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:04 user nova-compute[74959]: DEBUG nova.network.neutron [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.network.neutron [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Releasing lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converting VIF {"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG os_vif [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db303b8d-43c6-5b9d-aa3c-947b5cf2e8f8', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf21d9813-77, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf21d9813-77, col_values=(('qos', UUID('5653ec87-8c3e-430e-9b66-dcedf5abf7d0')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf21d9813-77, col_values=(('external_ids', {'iface-id': 'f21d9813-7728-4e0b-b624-604cc413dc12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:16:6d', 'vm-uuid': '6c504232-f516-4764-8df1-7bff0a3bd413'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: INFO os_vif [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77')
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converting VIF {"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] attach device xml: <interface type="ethernet">
Nov 28 23:01:05 user nova-compute[74959]:   <mac address="fa:16:3e:a6:16:6d"/>
Nov 28 23:01:05 user nova-compute[74959]:   <model type="virtio"/>
Nov 28 23:01:05 user nova-compute[74959]:   <mtu size="1442"/>
Nov 28 23:01:05 user nova-compute[74959]:   <target dev="tapf21d9813-77"/>
Nov 28 23:01:05 user nova-compute[74959]: </interface>
Nov 28 23:01:05 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:05 user nova-compute[74959]: WARNING nova.compute.manager [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state stopped and task_state None.
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-changed-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Refreshing instance network info cache due to event network-changed-f21d9813-7728-4e0b-b624-604cc413dc12. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] Acquiring lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] Acquired lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.network.neutron [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Refreshing network info cache for port f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No BDM found with device name hda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No VIF found with MAC fa:16:3e:84:4e:67, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:01:05 user nova-compute[74959]:   <nova:package version="0.0.0"/>
Nov 28 23:01:05 user nova-compute[74959]:   <nova:name>tempest-device-tagging-server-536022995</nova:name>
Nov 28 23:01:05 user nova-compute[74959]:   <nova:creationTime>2023-11-28 23:01:05</nova:creationTime>
Nov 28 23:01:05 user nova-compute[74959]:   <nova:flavor name="m1.tiny">
Nov 28 23:01:05 user nova-compute[74959]:     <nova:memory>512</nova:memory>
Nov 28 23:01:05 user nova-compute[74959]:     <nova:disk>1</nova:disk>
Nov 28 23:01:05 user nova-compute[74959]:     <nova:swap>0</nova:swap>
Nov 28 23:01:05 user nova-compute[74959]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:01:05 user nova-compute[74959]:     <nova:vcpus>1</nova:vcpus>
Nov 28 23:01:05 user nova-compute[74959]:   </nova:flavor>
Nov 28 23:01:05 user nova-compute[74959]:   <nova:owner>
Nov 28 23:01:05 user nova-compute[74959]:     <nova:user uuid="1ee17e5f07f04b31b55b3fa94c8cf8a5">tempest-TaggedAttachmentsTest-1971458541-project-member</nova:user>
Nov 28 23:01:05 user nova-compute[74959]:     <nova:project uuid="01c3efd63364440eb53df04de34a01bc">tempest-TaggedAttachmentsTest-1971458541</nova:project>
Nov 28 23:01:05 user nova-compute[74959]:   </nova:owner>
Nov 28 23:01:05 user nova-compute[74959]:   <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:01:05 user nova-compute[74959]:   <nova:ports>
Nov 28 23:01:05 user nova-compute[74959]:     <nova:port uuid="c3f3885d-8bb2-465b-a52f-b9ee64375c47">
Nov 28 23:01:05 user nova-compute[74959]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:01:05 user nova-compute[74959]:     </nova:port>
Nov 28 23:01:05 user nova-compute[74959]:     <nova:port uuid="f21d9813-7728-4e0b-b624-604cc413dc12">
Nov 28 23:01:05 user nova-compute[74959]:       <nova:ip type="fixed" address="10.10.10.166" ipVersion="4"/>
Nov 28 23:01:05 user nova-compute[74959]:     </nova:port>
Nov 28 23:01:05 user nova-compute[74959]:   </nova:ports>
Nov 28 23:01:05 user nova-compute[74959]: </nova:instance>
Nov 28 23:01:05 user nova-compute[74959]:  {{(pid=74959) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f8dfa2d0-f623-4bf4-b93f-b3aa0205030a tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "interface-6c504232-f516-4764-8df1-7bff0a3bd413-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.331s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lazy-loading 'flavor' on Instance uuid 17495411-b15b-4660-b2fe-42749b11ed49 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.network.neutron [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updated VIF entry in instance network info cache for port f21d9813-7728-4e0b-b624-604cc413dc12. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.network.neutron [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-050da0bf-7324-4666-ab4c-ecc4026affb0 req-2ee70d2c-1306-46bd-867f-e9ffa3d10602 service nova] Releasing lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:06 user nova-compute[74959]: INFO nova.compute.manager [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Attaching volume 383d2a33-3a93-4a1a-bd12-45e898ae3c31 to /dev/sdc
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.objects.instance [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lazy-loading 'flavor' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.utils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6f966-50a4-4d4f-b724-c685d5ed8950]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c11c8d-ba57-44d8-9a4c-7b445ebc7780]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[593ce5bb-3c73-4332-b0d5-d537ad44f5c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe487f3-f947-4bbf-8c3d-43f5f0e8cc00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:06 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[34114d42-909f-4cf4-888b-439d2296ee19]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.utils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Updating existing volume attachment record: aa951ae9-0ab8-4dc4-8782-b532b82a6067 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:06 user nova-compute[74959]: INFO nova.compute.manager [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Attaching volume e695d7e8-8d46-4ce9-8b67-9159224154a3 to /dev/vdb
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.utils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef2d25-a7ce-4bb9-8210-796077904dd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4c8dc-2e44-4a4a-9fe7-3970cc4ac941]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3111a4a1-df87-4ee7-bec0-55f607bb30f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c6bcb1-ba6a-4631-9db9-b85cf242bc2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:06 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e020fec-7465-4a62-b119-b9ab49ad8f07]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG os_brick.utils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating existing volume attachment record: 94c8f58e-d0fa-47da-aead-b954a0bcf7a7 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-fbfbe25f-b27c-4237-a4aa-b26364dbca5e req-f83dc592-aed5-4945-b0fc-dd8fd2fa24ab service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received event network-changed-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-fbfbe25f-b27c-4237-a4aa-b26364dbca5e req-f83dc592-aed5-4945-b0fc-dd8fd2fa24ab service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Refreshing instance network info cache due to event network-changed-298ec03c-3fde-4afb-a05e-fff5d0b2af54. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fbfbe25f-b27c-4237-a4aa-b26364dbca5e req-f83dc592-aed5-4945-b0fc-dd8fd2fa24ab service nova] Acquiring lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fbfbe25f-b27c-4237-a4aa-b26364dbca5e req-f83dc592-aed5-4945-b0fc-dd8fd2fa24ab service nova] Acquired lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:06 user nova-compute[74959]: DEBUG nova.network.neutron [req-fbfbe25f-b27c-4237-a4aa-b26364dbca5e req-f83dc592-aed5-4945-b0fc-dd8fd2fa24ab service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Refreshing network info cache for port 298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.network.neutron [req-fbfbe25f-b27c-4237-a4aa-b26364dbca5e req-f83dc592-aed5-4945-b0fc-dd8fd2fa24ab service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Updated VIF entry in instance network info cache for port 298ec03c-3fde-4afb-a05e-fff5d0b2af54. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.network.neutron [req-fbfbe25f-b27c-4237-a4aa-b26364dbca5e req-f83dc592-aed5-4945-b0fc-dd8fd2fa24ab service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Updating instance_info_cache with network_info: [{"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fbfbe25f-b27c-4237-a4aa-b26364dbca5e req-f83dc592-aed5-4945-b0fc-dd8fd2fa24ab service nova] Releasing lock "refresh_cache-ab7dbb0e-6b7e-4250-b0b9-23307c335494" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "6f965725-6fae-4b8a-abe2-801d29c8a21e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] No waiting events found dispatching network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:07 user nova-compute[74959]: WARNING nova.compute.manager [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received unexpected event network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 for instance with vm_state active and task_state None.
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] No waiting events found dispatching network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:07 user nova-compute[74959]: WARNING nova.compute.manager [req-fc825948-26ba-4107-9ab1-3b9592cc6cc6 req-a851d343-ff86-47fa-92f7-f283fe442e6b service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received unexpected event network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 for instance with vm_state active and task_state None.
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:01:07 user nova-compute[74959]: INFO nova.compute.claims [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Claim successful on node user
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:01:07 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:01:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.policy [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f0d2814e7e4df6904596bc07befe0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c57e434911c407189c1801142c226e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:01:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Creating image(s)
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "/opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "/opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.169s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk 1073741824" returned: 0 in 0.047s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Successfully created port: f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.166s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:01:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Cannot resize image /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Ensure instance console log exists: /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Successfully updated port: f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquired lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-27a65159-095d-4e3b-aace-966b24ff9625 req-0b3c6547-a2fa-4dc4-8896-35b539448ad7 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received event network-changed-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-27a65159-095d-4e3b-aace-966b24ff9625 req-0b3c6547-a2fa-4dc4-8896-35b539448ad7 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Refreshing instance network info cache due to event network-changed-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-27a65159-095d-4e3b-aace-966b24ff9625 req-0b3c6547-a2fa-4dc4-8896-35b539448ad7 service nova] Acquiring lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Updating instance_info_cache with network_info: [{"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Releasing lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Instance network_info: |[{"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-27a65159-095d-4e3b-aace-966b24ff9625 req-0b3c6547-a2fa-4dc4-8896-35b539448ad7 service nova] Acquired lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.neutron [req-27a65159-095d-4e3b-aace-966b24ff9625 req-0b3c6547-a2fa-4dc4-8896-35b539448ad7 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Refreshing network info cache for port f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Start _get_guest_xml network_info=[{"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:01:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:01:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109714954',display_name='tempest-AttachVolumeNegativeTest-server-109714954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109714954',id=13,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtrglnvlf5TG5fusNreonhV0Ot8vcCYFmufhN08lYfpAI5q4PzrJ81l5XgFXf+xi+7zyhkgfw+srWipPjXSewFxxPlNOa8H1XnRoConPnyNvYa3xDlg4d442dgJg72R9Q==',key_name='tempest-keypair-974326308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-44r06lj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=6f965725-6fae-4b8a-abe2-801d29c8a21e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:f5,bridge_name='br-int',has_traffic_filtering=True,id=f2eb1d0a-b86d-4e1f-93b3-6db50ebafded,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eb1d0a-b8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.objects.instance [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f965725-6fae-4b8a-abe2-801d29c8a21e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:01:09 user nova-compute[74959]:   <uuid>6f965725-6fae-4b8a-abe2-801d29c8a21e</uuid>
Nov 28 23:01:09 user nova-compute[74959]:   <name>instance-0000000d</name>
Nov 28 23:01:09 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:01:09 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:01:09 user nova-compute[74959]:   <metadata>
Nov 28 23:01:09 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:01:09 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:01:09 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeNegativeTest-server-109714954</nova:name>
Nov 28 23:01:09 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:01:09</nova:creationTime>
Nov 28 23:01:09 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:01:09 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:01:09 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:01:09 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:01:09 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:01:09 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:01:09 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:01:09 user nova-compute[74959]:       <nova:owner>
Nov 28 23:01:09 user nova-compute[74959]:         <nova:user uuid="11f0d2814e7e4df6904596bc07befe0e">tempest-AttachVolumeNegativeTest-1174707224-project-member</nova:user>
Nov 28 23:01:09 user nova-compute[74959]:         <nova:project uuid="1c57e434911c407189c1801142c226e1">tempest-AttachVolumeNegativeTest-1174707224</nova:project>
Nov 28 23:01:09 user nova-compute[74959]:       </nova:owner>
Nov 28 23:01:09 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:01:09 user nova-compute[74959]:       <nova:ports>
Nov 28 23:01:09 user nova-compute[74959]:         <nova:port uuid="f2eb1d0a-b86d-4e1f-93b3-6db50ebafded">
Nov 28 23:01:09 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:01:09 user nova-compute[74959]:         </nova:port>
Nov 28 23:01:09 user nova-compute[74959]:       </nova:ports>
Nov 28 23:01:09 user nova-compute[74959]:     </nova:instance>
Nov 28 23:01:09 user nova-compute[74959]:   </metadata>
Nov 28 23:01:09 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:01:09 user nova-compute[74959]:     <system>
Nov 28 23:01:09 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:01:09 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:01:09 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:01:09 user nova-compute[74959]:       <entry name="serial">6f965725-6fae-4b8a-abe2-801d29c8a21e</entry>
Nov 28 23:01:09 user nova-compute[74959]:       <entry name="uuid">6f965725-6fae-4b8a-abe2-801d29c8a21e</entry>
Nov 28 23:01:09 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:01:09 user nova-compute[74959]:     </system>
Nov 28 23:01:09 user nova-compute[74959]:   </sysinfo>
Nov 28 23:01:09 user nova-compute[74959]:   <os>
Nov 28 23:01:09 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:01:09 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:01:09 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:01:09 user nova-compute[74959]:   </os>
Nov 28 23:01:09 user nova-compute[74959]:   <features>
Nov 28 23:01:09 user nova-compute[74959]:     <acpi/>
Nov 28 23:01:09 user nova-compute[74959]:     <apic/>
Nov 28 23:01:09 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:01:09 user nova-compute[74959]:   </features>
Nov 28 23:01:09 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:01:09 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:01:09 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:01:09 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:01:09 user nova-compute[74959]:   </clock>
Nov 28 23:01:09 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:01:09 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:01:09 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:01:09 user nova-compute[74959]:   </cpu>
Nov 28 23:01:09 user nova-compute[74959]:   <devices>
Nov 28 23:01:09 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:01:09 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:01:09 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk"/>
Nov 28 23:01:09 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:01:09 user nova-compute[74959]:     </disk>
Nov 28 23:01:09 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:01:09 user nova-compute[74959]:       <mac address="fa:16:3e:67:61:f5"/>
Nov 28 23:01:09 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:01:09 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:01:09 user nova-compute[74959]:       <target dev="tapf2eb1d0a-b8"/>
Nov 28 23:01:09 user nova-compute[74959]:     </interface>
Nov 28 23:01:09 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:01:09 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/console.log" append="off"/>
Nov 28 23:01:09 user nova-compute[74959]:     </serial>
Nov 28 23:01:09 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:01:09 user nova-compute[74959]:     <video>
Nov 28 23:01:09 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:01:09 user nova-compute[74959]:     </video>
Nov 28 23:01:09 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:01:09 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:01:09 user nova-compute[74959]:     </rng>
Nov 28 23:01:09 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:01:09 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:01:09 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:01:09 user nova-compute[74959]:     </memballoon>
Nov 28 23:01:09 user nova-compute[74959]:   </devices>
Nov 28 23:01:09 user nova-compute[74959]: </domain>
Nov 28 23:01:09 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109714954',display_name='tempest-AttachVolumeNegativeTest-server-109714954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109714954',id=13,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtrglnvlf5TG5fusNreonhV0Ot8vcCYFmufhN08lYfpAI5q4PzrJ81l5XgFXf+xi+7zyhkgfw+srWipPjXSewFxxPlNOa8H1XnRoConPnyNvYa3xDlg4d442dgJg72R9Q==',key_name='tempest-keypair-974326308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-44r06lj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=6f965725-6fae-4b8a-abe2-801d29c8a21e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:f5,bridge_name='br-int',has_traffic_filtering=True,id=f2eb1d0a-b86d-4e1f-93b3-6db50ebafded,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eb1d0a-b8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG os_vif [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:f5,bridge_name='br-int',has_traffic_filtering=True,id=f2eb1d0a-b86d-4e1f-93b3-6db50ebafded,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eb1d0a-b8') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58d86c4f-c872-5e37-b8da-d2d49bc313f0', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2eb1d0a-b8, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2eb1d0a-b8, col_values=(('qos', UUID('b27a73d6-6845-4d01-b723-dca9cbfd5705')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2eb1d0a-b8, col_values=(('external_ids', {'iface-id': 'f2eb1d0a-b86d-4e1f-93b3-6db50ebafded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:61:f5', 'vm-uuid': '6f965725-6fae-4b8a-abe2-801d29c8a21e'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:09 user nova-compute[74959]: INFO os_vif [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:f5,bridge_name='br-int',has_traffic_filtering=True,id=f2eb1d0a-b86d-4e1f-93b3-6db50ebafded,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eb1d0a-b8')
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No VIF found with MAC fa:16:3e:67:61:f5, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:10 user nova-compute[74959]: DEBUG nova.network.neutron [req-27a65159-095d-4e3b-aace-966b24ff9625 req-0b3c6547-a2fa-4dc4-8896-35b539448ad7 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Updated VIF entry in instance network info cache for port f2eb1d0a-b86d-4e1f-93b3-6db50ebafded. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:01:10 user nova-compute[74959]: DEBUG nova.network.neutron [req-27a65159-095d-4e3b-aace-966b24ff9625 req-0b3c6547-a2fa-4dc4-8896-35b539448ad7 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Updating instance_info_cache with network_info: [{"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-27a65159-095d-4e3b-aace-966b24ff9625 req-0b3c6547-a2fa-4dc4-8896-35b539448ad7 service nova] Releasing lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-cb924f4e-f7bd-4b13-a074-484e3d9d836e req-81bf3c87-b226-4d84-9491-b9c27294af4f service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received event network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cb924f4e-f7bd-4b13-a074-484e3d9d836e req-81bf3c87-b226-4d84-9491-b9c27294af4f service nova] Acquiring lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cb924f4e-f7bd-4b13-a074-484e3d9d836e req-81bf3c87-b226-4d84-9491-b9c27294af4f service nova] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cb924f4e-f7bd-4b13-a074-484e3d9d836e req-81bf3c87-b226-4d84-9491-b9c27294af4f service nova] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-cb924f4e-f7bd-4b13-a074-484e3d9d836e req-81bf3c87-b226-4d84-9491-b9c27294af4f service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] No waiting events found dispatching network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:11 user nova-compute[74959]: WARNING nova.compute.manager [req-cb924f4e-f7bd-4b13-a074-484e3d9d836e req-81bf3c87-b226-4d84-9491-b9c27294af4f service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received unexpected event network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded for instance with vm_state building and task_state spawning.
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-620b0dc9-d261-4981-a1c6-bbc5223f87cd req-d8803c04-a078-44d3-b982-db7834dd6f9e service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received event network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-620b0dc9-d261-4981-a1c6-bbc5223f87cd req-d8803c04-a078-44d3-b982-db7834dd6f9e service nova] Acquiring lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-620b0dc9-d261-4981-a1c6-bbc5223f87cd req-d8803c04-a078-44d3-b982-db7834dd6f9e service nova] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-620b0dc9-d261-4981-a1c6-bbc5223f87cd req-d8803c04-a078-44d3-b982-db7834dd6f9e service nova] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-620b0dc9-d261-4981-a1c6-bbc5223f87cd req-d8803c04-a078-44d3-b982-db7834dd6f9e service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] No waiting events found dispatching network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:13 user nova-compute[74959]: WARNING nova.compute.manager [req-620b0dc9-d261-4981-a1c6-bbc5223f87cd req-d8803c04-a078-44d3-b982-db7834dd6f9e service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received unexpected event network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded for instance with vm_state building and task_state spawning.
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:01:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Instance spawned successfully.
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:01:13 user nova-compute[74959]: INFO nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 28 23:01:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:01:13 user nova-compute[74959]: INFO nova.compute.manager [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Took 6.07 seconds to build instance.
Nov 28 23:01:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7f225dd0-4b44-494d-816c-a3f5f9d3895a tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.180s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-f27ae6a3-3733-496a-b3c6-ee9f23ba7b83 req-0d54c5c4-8867-4972-b728-9e8e29c311ac service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received event network-changed-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-f27ae6a3-3733-496a-b3c6-ee9f23ba7b83 req-0d54c5c4-8867-4972-b728-9e8e29c311ac service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Refreshing instance network info cache due to event network-changed-e9513da7-b67d-4b0f-b277-5c533a317db1. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f27ae6a3-3733-496a-b3c6-ee9f23ba7b83 req-0d54c5c4-8867-4972-b728-9e8e29c311ac service nova] Acquiring lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f27ae6a3-3733-496a-b3c6-ee9f23ba7b83 req-0d54c5c4-8867-4972-b728-9e8e29c311ac service nova] Acquired lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-f27ae6a3-3733-496a-b3c6-ee9f23ba7b83 req-0d54c5c4-8867-4972-b728-9e8e29c311ac service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Refreshing network info cache for port e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-f27ae6a3-3733-496a-b3c6-ee9f23ba7b83 req-0d54c5c4-8867-4972-b728-9e8e29c311ac service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Updated VIF entry in instance network info cache for port e9513da7-b67d-4b0f-b277-5c533a317db1. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-f27ae6a3-3733-496a-b3c6-ee9f23ba7b83 req-0d54c5c4-8867-4972-b728-9e8e29c311ac service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Updating instance_info_cache with network_info: [{"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f27ae6a3-3733-496a-b3c6-ee9f23ba7b83 req-0d54c5c4-8867-4972-b728-9e8e29c311ac service nova] Releasing lock "refresh_cache-d0d20108-9362-4586-9d9d-88522ce58ad7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqYpfdPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:14 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:14 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:14 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4feebc-098d-4fbd-9030-ac0aa42cdfbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:14 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[31391735-b46f-49b6-8b18-2100f4366097]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3] added
Nov 28 23:01:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG nova.objects.instance [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lazy-loading 'flavor' on Instance uuid ab7dbb0e-6b7e-4250-b0b9-23307c335494 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0e173-ec11-440d-8bfe-6c993183e93f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[293f99a5-9372-4513-a94a-9a12dd91f1a5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqYpfdPX {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TqYpfdPX" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eda98f-40ca-4dd3-8c7a-23f380b7c5e7]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TqYpfdPX'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[785f15eb-2263-4a74-a035-957b05bff591]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6633c995-9487-4417-bdde-166a33c353ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:14 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:14 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:14 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:14 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:14 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:14 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:14 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:14 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaf4440-a575-4c16-936e-d6669d98f4db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3, portal: 172.16.0.220,3260]
Nov 28 23:01:15 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:15 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lazy-loading 'flavor' on Instance uuid d0d20108-9362-4586-9d9d-88522ce58ad7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4085d0b4-9a56-4c65-90e5-19d2980167a4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2748853c-59cd-42a1-96d2-01e2fe1d63ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:15 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:15 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:15 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecdb63d-9785-4d29-8485-f882f26e6505]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqYpfdPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:15 user nova-compute[74959]: INFO nova.compute.manager [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Attaching volume 24ca1a51-2325-440a-bb07-c369e72aa523 to /dev/vdb
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.143s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.utils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[49337f30-99d2-4e36-a7a8-b826cf6463dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f686ea-6470-408b-b3ee-1073565405a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2a6173-0cd8-42a3-a906-713787bcab45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb257d8-f820-44f3-a404-68e64241ca78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:15 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e20bdf-f2df-4aab-9f98-093dc33654f9]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG os_brick.utils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Updating existing volume attachment record: ff26295c-0617-4999-b6d5-40dcf20b3d67 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:15 user nova-compute[74959]: INFO nova.compute.manager [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Attaching volume 89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 to /dev/vdb
Nov 28 23:01:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23437353637623938', 'path': '/dev/sdg'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437353637623938', 'path': '/dev/sdg'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:16 user nova-compute[74959]: DEBUG nova.objects.instance [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lazy-loading 'flavor' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:01:16 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:16 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:01:16 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:16 user nova-compute[74959]:   <serial>e695d7e8-8d46-4ce9-8b67-9159224154a3</serial>
Nov 28 23:01:16 user nova-compute[74959]: </disk>
Nov 28 23:01:16 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:01:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No BDM found with device name hda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] No VIF found with MAC fa:16:3e:84:4e:67, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXkiCfYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:18 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:18 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:18 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89b072b-7803-42e2-b730-a1b6d389c92b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:18 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f347a79-3771-4ed0-a2c1-2f29ebcd086d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85] added
Nov 28 23:01:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRBlthXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:18 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[073abd8a-3626-437f-892d-b42e29e93373]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[475ccf86-4159-4803-8f44-d717d7187f4b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXkiCfYn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXkiCfYn" returned: 0 in 0.036s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9c0d91-be49-4b01-b5f3-319050a38a1d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PXkiCfYn'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f7fa2-7b5f-49cb-8fcd-ddfb3a7110d2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.utils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3d3fd7-e3af-4f59-bb2f-0b775d6488cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1411ca99-f144-4f10-b7ac-eca23ef5c674 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.141s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c0cb01-a1c5-4bc7-8b2c-1ffc1f976ab9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77a9c2-f0b6-451e-be0a-b521d3390a06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08efa43-2dde-414b-9dc0-8dd716c2e904]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cd73b7-6f1a-42e1-a701-8ca2fcf85050]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81c7be4-13b1-415f-a6fd-debd5f1b7660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85, portal: 172.16.0.220,3260]
Nov 28 23:01:18 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:18 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8f253d-0201-45b5-b936-3ef5e1da16fe]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.utils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Updating existing volume attachment record: 120b7f52-0965-4359-9716-dd2f0de98256 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed76d7-b091-4700-8238-cf06ce4f81c3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e853d-765e-4834-b03f-3ef5c017cd1a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:18 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d316e0-8d04-4a52-9a35-771cf6f33e01]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXkiCfYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '23036356331663266', 'path': '/dev/sdh'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036356331663266', 'path': '/dev/sdh'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.397s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:19 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:19 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lazy-loading 'flavor' on Instance uuid d339c51b-2c03-4ac9-800f-b5dc053e0585 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f50e9f-036b-4b0f-888f-faed904fd3a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:19 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:01:19 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:19 user nova-compute[74959]:   <source dev="/dev/sdh"/>
Nov 28 23:01:19 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:19 user nova-compute[74959]:   <serial>aa49697e-f7ba-4e00-a3ce-e080f008ac85</serial>
Nov 28 23:01:19 user nova-compute[74959]: </disk>
Nov 28 23:01:19 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c969662d-056d-41e8-9634-e2bfaa314799]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31] added
Nov 28 23:01:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b0c40-b7e4-42cb-88d4-2cc2abac588e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4051dd01-5702-430e-8256-0869737f1e2f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRBlthXn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRBlthXn" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4a466-2830-4625-9843-47beb24492a8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PRBlthXn'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de06fa-aa79-4eb5-b1bf-d2694139baca]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9080eb-ed9b-4bf9-80ca-9fe1b4d67027]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c759045f-1430-46ff-96ab-089abf2e2611]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31, portal: 172.16.0.220,3260]
Nov 28 23:01:20 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1117ee-df8c-4bcb-9e55-d67368b25c3a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33bf666-def7-4300-b052-37c92e3a20b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb00d4bd-543a-4507-b558-6f53c086d233]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRBlthXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] No VIF found with MAC fa:16:3e:d6:86:26, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6eee1d0d-ac9e-4192-ad52-5427dd8807d0 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.534s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:20 user nova-compute[74959]: INFO nova.compute.manager [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Detaching volume e695d7e8-8d46-4ce9-8b67-9159224154a3
Nov 28 23:01:20 user nova-compute[74959]: INFO nova.virt.block_device [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Attempting to driver detach volume e695d7e8-8d46-4ce9-8b67-9159224154a3 from mountpoint /dev/vdb
Nov 28 23:01:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Attempting to detach device vdb from instance 6c504232-f516-4764-8df1-7bff0a3bd413 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:01:20 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:20 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:01:20 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:20 user nova-compute[74959]:   <serial>e695d7e8-8d46-4ce9-8b67-9159224154a3</serial>
Nov 28 23:01:20 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 23:01:20 user nova-compute[74959]: </disk>
Nov 28 23:01:20 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Successfully detached device vdb from instance 6c504232-f516-4764-8df1-7bff0a3bd413 from the persistent domain config.
Nov 28 23:01:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c504232-f516-4764-8df1-7bff0a3bd413 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:01:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:01:20 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:20 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:01:20 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:20 user nova-compute[74959]:   <serial>e695d7e8-8d46-4ce9-8b67-9159224154a3</serial>
Nov 28 23:01:20 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 23:01:20 user nova-compute[74959]: </disk>
Nov 28 23:01:20 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] <== connect_volume: return (2800ms) {'type': 'block', 'scsi_wwn': '26331663664373430', 'path': '/dev/sdi'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331663664373430', 'path': '/dev/sdi'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lazy-loading 'flavor' on Instance uuid 17495411-b15b-4660-b2fe-42749b11ed49 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:01:21 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:21 user nova-compute[74959]:   <source dev="/dev/sdi"/>
Nov 28 23:01:21 user nova-compute[74959]:   <target dev="sdc" bus="scsi"/>
Nov 28 23:01:21 user nova-compute[74959]:   <serial>383d2a33-3a93-4a1a-bd12-45e898ae3c31</serial>
Nov 28 23:01:21 user nova-compute[74959]:   <address type="drive" controller="0" unit="2"/>
Nov 28 23:01:21 user nova-compute[74959]: </disk>
Nov 28 23:01:21 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:21 user nova-compute[74959]: INFO nova.compute.manager [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Detaching volume aa49697e-f7ba-4e00-a3ce-e080f008ac85
Nov 28 23:01:21 user nova-compute[74959]: INFO nova.virt.block_device [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Attempting to driver detach volume aa49697e-f7ba-4e00-a3ce-e080f008ac85 from mountpoint /dev/vdb
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Attempting to detach device vdb from instance d339c51b-2c03-4ac9-800f-b5dc053e0585 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:01:21 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:21 user nova-compute[74959]:   <source dev="/dev/sdh"/>
Nov 28 23:01:21 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:21 user nova-compute[74959]:   <serial>aa49697e-f7ba-4e00-a3ce-e080f008ac85</serial>
Nov 28 23:01:21 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:01:21 user nova-compute[74959]: </disk>
Nov 28 23:01:21 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:21 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Successfully detached device vdb from instance d339c51b-2c03-4ac9-800f-b5dc053e0585 from the persistent domain config.
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d339c51b-2c03-4ac9-800f-b5dc053e0585 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:01:21 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:21 user nova-compute[74959]:   <source dev="/dev/sdh"/>
Nov 28 23:01:21 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:21 user nova-compute[74959]:   <serial>aa49697e-f7ba-4e00-a3ce-e080f008ac85</serial>
Nov 28 23:01:21 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:01:21 user nova-compute[74959]: </disk>
Nov 28 23:01:21 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] No BDM found with device name sda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] No VIF found with MAC fa:16:3e:ec:ab:da, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f9faa31b-568c-4f44-994d-e40633c80708 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.725s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d339c51b-2c03-4ac9-800f-b5dc053e0585 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:23 user nova-compute[74959]: INFO nova.compute.manager [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Detaching volume 383d2a33-3a93-4a1a-bd12-45e898ae3c31
Nov 28 23:01:23 user nova-compute[74959]: INFO nova.virt.block_device [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Attempting to driver detach volume 383d2a33-3a93-4a1a-bd12-45e898ae3c31 from mountpoint /dev/sdc
Nov 28 23:01:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Attempting to detach device sdc from instance 17495411-b15b-4660-b2fe-42749b11ed49 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:01:23 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:23 user nova-compute[74959]:   <source dev="/dev/sdi"/>
Nov 28 23:01:23 user nova-compute[74959]:   <target dev="sdc" bus="scsi"/>
Nov 28 23:01:23 user nova-compute[74959]:   <serial>383d2a33-3a93-4a1a-bd12-45e898ae3c31</serial>
Nov 28 23:01:23 user nova-compute[74959]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 23:01:23 user nova-compute[74959]: </disk>
Nov 28 23:01:23 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:23 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Successfully detached device sdc from instance 17495411-b15b-4660-b2fe-42749b11ed49 from the persistent domain config.
Nov 28 23:01:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 17495411-b15b-4660-b2fe-42749b11ed49 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:01:23 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:23 user nova-compute[74959]:   <source dev="/dev/sdi"/>
Nov 28 23:01:23 user nova-compute[74959]:   <target dev="sdc" bus="scsi"/>
Nov 28 23:01:23 user nova-compute[74959]:   <serial>383d2a33-3a93-4a1a-bd12-45e898ae3c31</serial>
Nov 28 23:01:23 user nova-compute[74959]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 23:01:23 user nova-compute[74959]: </disk>
Nov 28 23:01:23 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:23 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:23 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:23 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 17495411-b15b-4660-b2fe-42749b11ed49 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[19332dee-fc4e-4aef-9fea-258ee5eacc59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:23 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9aec0f-fd38-40cb-b708-020301776003]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523] added
Nov 28 23:01:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[475d37f1-184d-4e14-a9d8-234946b3a45f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4402713-1ed2-4e08-8ded-a029f3d4aa59]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opNVMKWQ {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opNVMKWQ" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e016eded-8d0a-426f-a8b2-88680eeeed0a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opNVMKWQ'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d969b1ae-022a-4299-aa54-bd426ee562fc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c448df9c-9e3d-4ff8-98fc-e5399498e70e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dc80ba-031c-4126-945c-a7d396fe3072]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260]
Nov 28 23:01:23 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8977d0e4-0e7d-40ec-86e6-9a9a6e8d8225]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb627d-9383-4d90-b1b5-b5851a9dc723]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e1e550-b8ec-4dd4-aa8d-c0566273bd79]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26534656433653734', 'path': '/dev/sdj'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534656433653734', 'path': '/dev/sdj'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:24 user nova-compute[74959]: DEBUG nova.objects.instance [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lazy-loading 'flavor' on Instance uuid ab7dbb0e-6b7e-4250-b0b9-23307c335494 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:01:24 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:24 user nova-compute[74959]:   <source dev="/dev/sdj"/>
Nov 28 23:01:24 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:24 user nova-compute[74959]:   <serial>24ca1a51-2325-440a-bb07-c369e72aa523</serial>
Nov 28 23:01:24 user nova-compute[74959]: </disk>
Nov 28 23:01:24 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:01:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] No VIF found with MAC fa:16:3e:c1:44:5b, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-aa7a10ab-b1fb-4348-90a2-4264fdf4a38d tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.396s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG os_brick.utils [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[85403b40-4901-4e97-af93-0b711441df90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b6abd9-fa5b-45a2-b2f8-a02ce4a67dcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[51764cc4-10cd-45f1-a07e-93f37e1d440f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[138149a9-84d9-4a72-98c3-9c17b42a4b8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:26 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:01:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[416e4a2c-844e-42f0-915c-02cd3eb9c340]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:01:26 user nova-compute[74959]: DEBUG os_brick.utils [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:26 user nova-compute[74959]: INFO nova.compute.manager [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Swapping volume 24ca1a51-2325-440a-bb07-c369e72aa523 for 69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZLbMPao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:27 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:27 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:27 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba34f16-62e2-45f5-9265-4a91b39c813c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:27 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba481d88-b80a-42cb-8bf0-732c90d0e840]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91] added
Nov 28 23:01:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca416d60-0f8e-4202-8025-5f17162eb38d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f264c8a3-333e-4af1-a11f-848b1c32ebaf]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cZLbMPao {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cZLbMPao" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e2c3ca-1469-4d39-b2c9-1ce935e54e2f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cZLbMPao'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ada4573-23f6-48fc-b7ff-b75fc6c484a9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a2e92f-3316-4460-b030-7b0fe80abb92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f207c57-1414-4583-9786-5936856d9243]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91, portal: 172.16.0.220,3260]
Nov 28 23:01:27 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b742eb64-dea7-4d82-976a-8bfe8f231352]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e135f299-a756-4787-bd2f-3198cef539af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2113cc4-f6b4-451d-aada-dbb10b9ca75e]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZLbMPao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26339653032393732', 'path': '/dev/sdk'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339653032393732', 'path': '/dev/sdk'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lazy-loading 'flavor' on Instance uuid d0d20108-9362-4586-9d9d-88522ce58ad7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 23:01:28 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:28 user nova-compute[74959]:   <source dev="/dev/sdk"/>
Nov 28 23:01:28 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:28 user nova-compute[74959]:   <serial>89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91</serial>
Nov 28 23:01:28 user nova-compute[74959]: </disk>
Nov 28 23:01:28 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:01:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:01:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] No VIF found with MAC fa:16:3e:04:00:f9, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:01:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c3bc7bd-407e-4d12-9f8b-bcc3a57ee13a tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.709s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8f807a3-902f-49aa-9d67-25e8216df202 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] volume_snapshot_create: create_info: {'snapshot_id': 'c4b1fbfb-c64a-482e-a3f4-4f99f1242a88', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74959) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 23:01:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8f807a3-902f-49aa-9d67-25e8216df202 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] snap xml: <domainsnapshot>
Nov 28 23:01:29 user nova-compute[74959]:   <disks>
Nov 28 23:01:29 user nova-compute[74959]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 28 23:01:29 user nova-compute[74959]:       <source file="/dev/new_file"/>
Nov 28 23:01:29 user nova-compute[74959]:     </disk>
Nov 28 23:01:29 user nova-compute[74959]:     <disk name="vda" snapshot="no"/>
Nov 28 23:01:29 user nova-compute[74959]:   </disks>
Nov 28 23:01:29 user nova-compute[74959]: </domainsnapshot>
Nov 28 23:01:29 user nova-compute[74959]:  {{(pid=74959) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 23:01:29 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e8f807a3-902f-49aa-9d67-25e8216df202 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] Lazy-loading 'system_metadata' on Instance uuid d0d20108-9362-4586-9d9d-88522ce58ad7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:29 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e8f807a3-902f-49aa-9d67-25e8216df202 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 23:01:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dfa5018a-c80e-4a8c-b343-6eb53c215ee2 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] volume_snapshot_delete: delete_info: {'volume_id': '89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91'} {{(pid=74959) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [None req-dfa5018a-c80e-4a8c-b343-6eb53c215ee2 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     if delete_info['type'] != 'qcow2':
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] KeyError: 'type'
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [None req-e8f807a3-902f-49aa-9d67-25e8216df202 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     rv = execute(f, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     six.reraise(c, e, tb)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     raise value
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     rv = meth(*args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [None req-e8f807a3-902f-49aa-9d67-25e8216df202 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     self._volume_snapshot_create(context, instance, guest,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     rv = execute(f, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     six.reraise(c, e, tb)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     raise value
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     rv = meth(*args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [None req-dfa5018a-c80e-4a8c-b343-6eb53c215ee2 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-297299a7-9e3f-4a59-b51c-4c4d9b454e7c)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server [None req-dfa5018a-c80e-4a8c-b343-6eb53c215ee2 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] Exception during message handling: KeyError: 'type'
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server 
Nov 28 23:01:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver [None req-e8f807a3-902f-49aa-9d67-25e8216df202 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c4b1fbfb-c64a-482e-a3f4-4f99f1242a88 could not be found.
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c4b1fbfb-c64a-482e-a3f4-4f99f1242a88 could not be found. (HTTP 404) (Request-ID: req-00746b9a-d0af-43e9-8959-95b42a0b50dd)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c4b1fbfb-c64a-482e-a3f4-4f99f1242a88 could not be found.
Nov 28 23:01:29 user nova-compute[74959]: ERROR nova.virt.libvirt.driver 
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server [None req-e8f807a3-902f-49aa-9d67-25e8216df202 tempest-VolumesAssistedSnapshotsTest-2040726036 tempest-VolumesAssistedSnapshotsTest-2040726036-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 23:01:29 user nova-compute[74959]: ERROR oslo_messaging.rpc.server 
Nov 28 23:01:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:30 user nova-compute[74959]: INFO nova.compute.manager [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Detaching volume 89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:30 user nova-compute[74959]: INFO nova.virt.block_device [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Attempting to driver detach volume 89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 from mountpoint /dev/vdb
Nov 28 23:01:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Attempting to detach device vdb from instance d0d20108-9362-4586-9d9d-88522ce58ad7 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:01:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 23:01:30 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:30 user nova-compute[74959]:   <source dev="/dev/sdk"/>
Nov 28 23:01:30 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:30 user nova-compute[74959]:   <serial>89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91</serial>
Nov 28 23:01:30 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:01:30 user nova-compute[74959]: </disk>
Nov 28 23:01:30 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:30 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Successfully detached device vdb from instance d0d20108-9362-4586-9d9d-88522ce58ad7 from the persistent domain config.
Nov 28 23:01:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0d20108-9362-4586-9d9d-88522ce58ad7 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:01:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 23:01:30 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:01:30 user nova-compute[74959]:   <source dev="/dev/sdk"/>
Nov 28 23:01:30 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:01:30 user nova-compute[74959]:   <serial>89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91</serial>
Nov 28 23:01:30 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:01:30 user nova-compute[74959]: </disk>
Nov 28 23:01:30 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0d20108-9362-4586-9d9d-88522ce58ad7 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:01:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:01:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:33 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updating instance_info_cache with network_info: [{"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZoxkTEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab7dbb0e-6b7e-4250-b0b9-23307c335494', 'attached_at': '', 'detached_at': '', 'volume_id': '69aadf45-fb0d-4764-90e2-724b5144bd23', 'serial': '69aadf45-fb0d-4764-90e2-724b5144bd23'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'ab7dbb0e-6b7e-4250-b0b9-23307c335494', 'attached_at': '', 'detached_at': '', 'volume_id': '24ca1a51-2325-440a-bb07-c369e72aa523', 'serial'} {{(pid=74959) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZoxkTEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:34 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:34 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:34 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b02ac0-765b-4aea-aab5-aa3fdb02d070]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:35 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1753730-ba2e-4b9f-ae83-51415d7fafaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23] added
Nov 28 23:01:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.111s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[708eb47c-5e23-44de-92c1-44d06ea69eb8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c375d714-9f85-4f38-9d08-85fa610bbb2d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZoxkTEr {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZoxkTEr" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab02958-feee-4b6b-932c-ef15d8324a08]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DZoxkTEr'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b4871d-cf9b-4f70-9910-5c7510d0d34a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0200c12f-bc37-44c0-8357-321ef870683f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb57439-e3d0-415f-9749-e28b8dfb5b29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23, portal: 172.16.0.220,3260]
Nov 28 23:01:35 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b2b090-a1e1-4c9f-8778-7c3049e72230]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c1697c-df30-4d78-8246-121bfa6f4289]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2664e3-f90f-455c-8bd6-6f3c181e755c]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZoxkTEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23737373332383461', 'path': '/dev/sdl'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737373332383461', 'path': '/dev/sdl'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG nova.objects.instance [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lazy-loading 'flavor' on Instance uuid ab7dbb0e-6b7e-4250-b0b9-23307c335494 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 182452224 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 336592896 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 482344960 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 645922816 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 801112064 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 934281216 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 1064304640 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:41 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac61ea-a00c-4acc-a091-867a9d9bbd49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:41 user nova-compute[74959]: No targets found.
Nov 28 23:01:41 user nova-compute[74959]: iSNS:
Nov 28 23:01:41 user nova-compute[74959]: No targets found.
Nov 28 23:01:41 user nova-compute[74959]: STATIC:
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:41 user nova-compute[74959]: No targets found.
Nov 28 23:01:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:41 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:41 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b4dbe-ecef-4e40-b1cf-bc242bc2df05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[156bc8cc-6be1-4c43-9904-cec2d685cc51]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4742cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523'): ({'sdj'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Removing single pathed devices sdj {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98374d9-344d-4ecc-bb31-b65c7d0d6c76]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d4d391-0e5b-4e46-adc9-10abe0695a47]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Flushing IO for device /dev/sdj {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eac9e1-336f-46e4-8321-a4e8815bec8c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.044s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f60874-58ef-48e9-b86b-ba9599f61ed8]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] SCSI volumes sdj have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:41 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c504232-f516-4764-8df1-7bff0a3bd413 is timed out.
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Successfully detached device vdb from instance 6c504232-f516-4764-8df1-7bff0a3bd413 from the live domain config.
Nov 28 23:01:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TqYpfdPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:41 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba285dd-1653-4937-ad84-e62943f866ec]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b849b10b-a848-465e-a13e-35dd77568fae]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260]
Nov 28 23:01:41 user nova-compute[74959]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a52b0f0-a85a-4360-8c19-7ffeee05c81f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] <== disconnect_volume: return (418ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.162s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a93681a-c3ac-486c-a71c-3d1d8d4c2ef1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:41 user nova-compute[74959]: No targets found.
Nov 28 23:01:41 user nova-compute[74959]: iSNS:
Nov 28 23:01:41 user nova-compute[74959]: No targets found.
Nov 28 23:01:41 user nova-compute[74959]: STATIC:
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441
Nov 28 23:01:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:41 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:41 user nova-compute[74959]: No targets found.
Nov 28 23:01:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:41 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:41 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf620adc-6162-40a2-b66a-9455913c5940]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZoxkTEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': 'ab7dbb0e-6b7e-4250-b0b9-23307c335494', 'attached_at': '', 'detached_at': '', 'volume_id': '69aadf45-fb0d-4764-90e2-724b5144bd23', 'serial'} {{(pid=74959) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] swap_volume: removing Cinder connection for volume 24ca1a51-2325-440a-bb07-c369e72aa523 {{(pid=74959) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdce7c4c-592c-49e9-bdd2-24c4f6cbcb2f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec101e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3'): ({'sdg'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Removing single pathed devices sdg {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec9241a-45a2-4426-9014-5eae67270667]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda9ceb6-a9ea-487d-96aa-832c82a8085f]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Flushing IO for device /dev/sdg {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[842eb4bd-4cf6-4989-a06b-be7eaeca6917]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c8aa95-fa26-430d-9f79-3e791cc8f28a]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[33185866-ed8e-46a6-b017-5705427ccf9a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[043398f7-ed47-45dd-91e2-38295ff26c29]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3, portal: 172.16.0.220,3260]
Nov 28 23:01:41 user nova-compute[74959]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e695d7e8-8d46-4ce9-8b67-9159224154a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeed50e4-c793-48ed-9188-2dab0ceba2ae]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d339c51b-2c03-4ac9-800f-b5dc053e0585 is timed out.
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.812s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] <== disconnect_volume: return (974ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:01:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Successfully detached device vdb from instance d339c51b-2c03-4ac9-800f-b5dc053e0585 from the live domain config.
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXkiCfYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:42 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:01:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=6986MB free_disk=25.422466278076172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[81045dbc-2601-4490-b065-ff798ad1e7ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:42 user nova-compute[74959]: No targets found.
Nov 28 23:01:42 user nova-compute[74959]: iSNS:
Nov 28 23:01:42 user nova-compute[74959]: No targets found.
Nov 28 23:01:42 user nova-compute[74959]: STATIC:
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441
Nov 28 23:01:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:42 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:42 user nova-compute[74959]: No targets found.
Nov 28 23:01:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:42 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:42 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c819c044-b07f-458b-ae80-e6813d4447aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[541649ac-d1d1-4b35-ad5a-06ea63bbf25f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:42 user nova-compute[74959]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 (non-flash)
Nov 28 23:01:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec367b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85'): ({'sdh'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Removing single pathed devices sdh {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134abfb-932d-4513-b397-5e36649d0864]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619df44-bd4e-4ef3-ad7a-7ad11f246979]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Flushing IO for device /dev/sdh {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d339c51b-2c03-4ac9-800f-b5dc053e0585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 17495411-b15b-4660-b2fe-42749b11ed49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6c504232-f516-4764-8df1-7bff0a3bd413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d0d20108-9362-4586-9d9d-88522ce58ad7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6f965725-6fae-4b8a-abe2-801d29c8a21e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e57a62-e3e8-4be1-8efa-b9b99494aa28]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff22dd6f-a515-46f9-94b5-a674883ea060]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] SCSI volumes sdh have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e010cbf2-b991-4451-808e-ae2dc6f6a347]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] swap_volume: Updating volume 24ca1a51-2325-440a-bb07-c369e72aa523 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "DZoxkTEr", "auth_password": "B9ob13Xt6YCNHw", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "69aadf45-fb0d-4764-90e2-724b5144bd23"}, "status": "reserved", "instance": "ab7dbb0e-6b7e-4250-b0b9-23307c335494", "attached_at": "", "detached_at": "", "volume_id": "69aadf45-fb0d-4764-90e2-724b5144bd23", "serial": "69aadf45-fb0d-4764-90e2-724b5144bd23"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '69aadf45-fb0d-4764-90e2-724b5144bd23', 'no_device': None, 'attachment_id': '984aad4e-6d4c-498a-aadd-9a40292253c0'} {{(pid=74959) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-69cf2b55-c74d-4533-bfae-0c5b123fccbe tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.037s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f89e38-7694-4803-99bf-d38791a422b4]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85, portal: 172.16.0.220,3260]
Nov 28 23:01:42 user nova-compute[74959]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa49697e-f7ba-4e00-a3ce-e080f008ac85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe2f66d-ccff-4d2a-9bf1-5f4553900d29]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] <== disconnect_volume: return (421ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-7cfee3d4-8a81-45f0-8ca2-5f7bc712fe28 req-b8a3b0e1-049d-4960-ac6b-b0de8da0faac service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-changed-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-7cfee3d4-8a81-45f0-8ca2-5f7bc712fe28 req-b8a3b0e1-049d-4960-ac6b-b0de8da0faac service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing instance network info cache due to event network-changed-9b5b8018-5907-4de7-8843-9486b57ab8e8. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7cfee3d4-8a81-45f0-8ca2-5f7bc712fe28 req-b8a3b0e1-049d-4960-ac6b-b0de8da0faac service nova] Acquiring lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7cfee3d4-8a81-45f0-8ca2-5f7bc712fe28 req-b8a3b0e1-049d-4960-ac6b-b0de8da0faac service nova] Acquired lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.network.neutron [req-7cfee3d4-8a81-45f0-8ca2-5f7bc712fe28 req-b8a3b0e1-049d-4960-ac6b-b0de8da0faac service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Refreshing network info cache for port 9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:01:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lazy-loading 'flavor' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.utils [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa777e4-190e-4b3d-ac45-8951882441c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 17495411-b15b-4660-b2fe-42749b11ed49 is timed out.
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a66e1a-bb05-47ce-ae49-b2d7f6ec380d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Successfully detached device sdc from instance 17495411-b15b-4660-b2fe-42749b11ed49 from the live domain config.
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRBlthXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:43 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e90c19cb-9a9e-4788-9ad2-9b29afda8566 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.931s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e81dbc7-1a0c-40f8-9b74-65115037c03e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[478e0b96-f8c5-4b59-930e-122d9a16f57f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bad32b9-7ca5-426e-90e4-1b073f34f2f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:43 user nova-compute[74959]: No targets found.
Nov 28 23:01:43 user nova-compute[74959]: iSNS:
Nov 28 23:01:43 user nova-compute[74959]: No targets found.
Nov 28 23:01:43 user nova-compute[74959]: STATIC:
Nov 28 23:01:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31
Nov 28 23:01:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c
Nov 28 23:01:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6
Nov 28 23:01:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441
Nov 28 23:01:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:43 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:43 user nova-compute[74959]: No targets found.
Nov 28 23:01:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:43 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:43 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:01:43 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d871c6-e6e5-4caa-8e16-a9b849fde9f2]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.utils [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdc34ee-c68a-4265-b969-44f29408eecd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4fbdc6-70d6-45f4-8140-13bc3fc75c7c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:43 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef421a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31'): ({'sdi'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Removing single pathed devices sdi {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[33470d33-68e2-4660-9fd2-79fe2dbd617e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6345cd-087c-4a5d-8e33-532799a599d1]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Flushing IO for device /dev/sdi {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: INFO nova.compute.manager [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Swapping volume 69aadf45-fb0d-4764-90e2-724b5144bd23 for 24ca1a51-2325-440a-bb07-c369e72aa523
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee1eb77-2145-4529-a7db-0ce80e8cb0a9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lazy-loading 'flavor' on Instance uuid d339c51b-2c03-4ac9-800f-b5dc053e0585 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6608aa54-4ee3-4870-9107-176f2df39cad]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] SCSI volumes sdi have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e399b5-38b9-46c5-8cf8-508bdcbca275]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d51edaff-624f-4a20-9a84-1b12f511a367 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.527s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG nova.network.neutron [req-7cfee3d4-8a81-45f0-8ca2-5f7bc712fe28 req-b8a3b0e1-049d-4960-ac6b-b0de8da0faac service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updated VIF entry in instance network info cache for port 9b5b8018-5907-4de7-8843-9486b57ab8e8. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG nova.network.neutron [req-7cfee3d4-8a81-45f0-8ca2-5f7bc712fe28 req-b8a3b0e1-049d-4960-ac6b-b0de8da0faac service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [{"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d7a3e-9cba-4b6d-a930-a3be910adaeb]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31, portal: 172.16.0.220,3260]
Nov 28 23:01:43 user nova-compute[74959]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7cfee3d4-8a81-45f0-8ca2-5f7bc712fe28 req-b8a3b0e1-049d-4960-ac6b-b0de8da0faac service nova] Releasing lock "refresh_cache-9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383d2a33-3a93-4a1a-bd12-45e898ae3c31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e40b0ea-1724-4ea4-998f-c676d54f600b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] <== disconnect_volume: return (416ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "interface-6c504232-f516-4764-8df1-7bff0a3bd413-f21d9813-7728-4e0b-b624-604cc413dc12" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "interface-6c504232-f516-4764-8df1-7bff0a3bd413-f21d9813-7728-4e0b-b624-604cc413dc12" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lazy-loading 'flavor' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converting VIF {"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface> {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface> {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Attempting to detach device tapf21d9813-77 from instance 6c504232-f516-4764-8df1-7bff0a3bd413 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] detach device xml: <interface type="ethernet">
Nov 28 23:01:44 user nova-compute[74959]:   <mac address="fa:16:3e:a6:16:6d"/>
Nov 28 23:01:44 user nova-compute[74959]:   <model type="virtio"/>
Nov 28 23:01:44 user nova-compute[74959]:   <mtu size="1442"/>
Nov 28 23:01:44 user nova-compute[74959]:   <target dev="tapf21d9813-77"/>
Nov 28 23:01:44 user nova-compute[74959]: </interface>
Nov 28 23:01:44 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface> {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 28 23:01:44 user nova-compute[74959]:   <name>instance-00000009</name>
Nov 28 23:01:44 user nova-compute[74959]:   <uuid>6c504232-f516-4764-8df1-7bff0a3bd413</uuid>
Nov 28 23:01:44 user nova-compute[74959]:   <metadata>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:01:44 user nova-compute[74959]:   <nova:package version="0.0.0"/>
Nov 28 23:01:44 user nova-compute[74959]:   <nova:name>tempest-device-tagging-server-536022995</nova:name>
Nov 28 23:01:44 user nova-compute[74959]:   <nova:creationTime>2023-11-28 23:01:05</nova:creationTime>
Nov 28 23:01:44 user nova-compute[74959]:   <nova:flavor name="m1.tiny">
Nov 28 23:01:44 user nova-compute[74959]:     <nova:memory>512</nova:memory>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:disk>1</nova:disk>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:swap>0</nova:swap>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:vcpus>1</nova:vcpus>
Nov 28 23:01:44 user nova-compute[74959]:   </nova:flavor>
Nov 28 23:01:44 user nova-compute[74959]:   <nova:owner>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:user uuid="1ee17e5f07f04b31b55b3fa94c8cf8a5">tempest-TaggedAttachmentsTest-1971458541-project-member</nova:user>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:project uuid="01c3efd63364440eb53df04de34a01bc">tempest-TaggedAttachmentsTest-1971458541</nova:project>
Nov 28 23:01:44 user nova-compute[74959]:   </nova:owner>
Nov 28 23:01:44 user nova-compute[74959]:   <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:01:44 user nova-compute[74959]:   <nova:ports>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:port uuid="c3f3885d-8bb2-465b-a52f-b9ee64375c47">
Nov 28 23:01:44 user nova-compute[74959]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:01:44 user nova-compute[74959]:     </nova:port>
Nov 28 23:01:44 user nova-compute[74959]:     <nova:port uuid="f21d9813-7728-4e0b-b624-604cc413dc12">
Nov 28 23:01:44 user nova-compute[74959]:       <nova:ip type="fixed" address="10.10.10.166" ipVersion="4"/>
Nov 28 23:01:44 user nova-compute[74959]:     </nova:port>
Nov 28 23:01:44 user nova-compute[74959]:   </nova:ports>
Nov 28 23:01:44 user nova-compute[74959]: </nova:instance>
Nov 28 23:01:44 user nova-compute[74959]:   </metadata>
Nov 28 23:01:44 user nova-compute[74959]:   <memory unit='KiB'>524288</memory>
Nov 28 23:01:44 user nova-compute[74959]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 23:01:44 user nova-compute[74959]:   <vcpu placement='static'>1</vcpu>
Nov 28 23:01:44 user nova-compute[74959]:   <resource>
Nov 28 23:01:44 user nova-compute[74959]:     <partition>/machine</partition>
Nov 28 23:01:44 user nova-compute[74959]:   </resource>
Nov 28 23:01:44 user nova-compute[74959]:   <sysinfo type='smbios'>
Nov 28 23:01:44 user nova-compute[74959]:     <system>
Nov 28 23:01:44 user nova-compute[74959]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 23:01:44 user nova-compute[74959]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 23:01:44 user nova-compute[74959]:       <entry name='version'>0.0.0</entry>
Nov 28 23:01:44 user nova-compute[74959]:       <entry name='serial'>6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 23:01:44 user nova-compute[74959]:       <entry name='uuid'>6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 23:01:44 user nova-compute[74959]:       <entry name='family'>Virtual Machine</entry>
Nov 28 23:01:44 user nova-compute[74959]:     </system>
Nov 28 23:01:44 user nova-compute[74959]:   </sysinfo>
Nov 28 23:01:44 user nova-compute[74959]:   <os>
Nov 28 23:01:44 user nova-compute[74959]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 23:01:44 user nova-compute[74959]:     <boot dev='hd'/>
Nov 28 23:01:44 user nova-compute[74959]:     <smbios mode='sysinfo'/>
Nov 28 23:01:44 user nova-compute[74959]:   </os>
Nov 28 23:01:44 user nova-compute[74959]:   <features>
Nov 28 23:01:44 user nova-compute[74959]:     <acpi/>
Nov 28 23:01:44 user nova-compute[74959]:     <apic/>
Nov 28 23:01:44 user nova-compute[74959]:     <vmcoreinfo state='on'/>
Nov 28 23:01:44 user nova-compute[74959]:   </features>
Nov 28 23:01:44 user nova-compute[74959]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 23:01:44 user nova-compute[74959]:     <model fallback='forbid'>Nehalem</model>
Nov 28 23:01:44 user nova-compute[74959]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 23:01:44 user nova-compute[74959]:     <feature policy='require' name='vme'/>
Nov 28 23:01:44 user nova-compute[74959]:     <feature policy='require' name='x2apic'/>
Nov 28 23:01:44 user nova-compute[74959]:     <feature policy='require' name='hypervisor'/>
Nov 28 23:01:44 user nova-compute[74959]:   </cpu>
Nov 28 23:01:44 user nova-compute[74959]:   <clock offset='utc'>
Nov 28 23:01:44 user nova-compute[74959]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 23:01:44 user nova-compute[74959]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 23:01:44 user nova-compute[74959]:     <timer name='hpet' present='no'/>
Nov 28 23:01:44 user nova-compute[74959]:   </clock>
Nov 28 23:01:44 user nova-compute[74959]:   <on_poweroff>destroy</on_poweroff>
Nov 28 23:01:44 user nova-compute[74959]:   <on_reboot>restart</on_reboot>
Nov 28 23:01:44 user nova-compute[74959]:   <on_crash>destroy</on_crash>
Nov 28 23:01:44 user nova-compute[74959]:   <devices>
Nov 28 23:01:44 user nova-compute[74959]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 23:01:44 user nova-compute[74959]:     <disk type='file' device='disk'>
Nov 28 23:01:44 user nova-compute[74959]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 23:01:44 user nova-compute[74959]:       <source file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk' index='2'/>
Nov 28 23:01:44 user nova-compute[74959]:       <backingStore type='file' index='3'>
Nov 28 23:01:44 user nova-compute[74959]:         <format type='raw'/>
Nov 28 23:01:44 user nova-compute[74959]:         <source file='/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8'/>
Nov 28 23:01:44 user nova-compute[74959]:         <backingStore/>
Nov 28 23:01:44 user nova-compute[74959]:       </backingStore>
Nov 28 23:01:44 user nova-compute[74959]:       <target dev='vda' bus='virtio'/>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='virtio-disk0'/>
Nov 28 23:01:44 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </disk>
Nov 28 23:01:44 user nova-compute[74959]:     <disk type='file' device='cdrom'>
Nov 28 23:01:44 user nova-compute[74959]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 23:01:44 user nova-compute[74959]:       <source file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.config' index='1'/>
Nov 28 23:01:44 user nova-compute[74959]:       <backingStore/>
Nov 28 23:01:44 user nova-compute[74959]:       <target dev='hda' bus='ide'/>
Nov 28 23:01:44 user nova-compute[74959]:       <readonly/>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='ide0-0-0'/>
Nov 28 23:01:44 user nova-compute[74959]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </disk>
Nov 28 23:01:44 user nova-compute[74959]:     <controller type='usb' index='0' model='none'>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='usb'/>
Nov 28 23:01:44 user nova-compute[74959]:     </controller>
Nov 28 23:01:44 user nova-compute[74959]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='pci.0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </controller>
Nov 28 23:01:44 user nova-compute[74959]:     <controller type='ide' index='0'>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='ide'/>
Nov 28 23:01:44 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 23:01:44 user nova-compute[74959]:     </controller>
Nov 28 23:01:44 user nova-compute[74959]:     <interface type='ethernet'>
Nov 28 23:01:44 user nova-compute[74959]:       <mac address='fa:16:3e:84:4e:67'/>
Nov 28 23:01:44 user nova-compute[74959]:       <target dev='tapc3f3885d-8b'/>
Nov 28 23:01:44 user nova-compute[74959]:       <model type='virtio'/>
Nov 28 23:01:44 user nova-compute[74959]:       <mtu size='1442'/>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='net0'/>
Nov 28 23:01:44 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </interface>
Nov 28 23:01:44 user nova-compute[74959]:     <interface type='ethernet'>
Nov 28 23:01:44 user nova-compute[74959]:       <mac address='fa:16:3e:a6:16:6d'/>
Nov 28 23:01:44 user nova-compute[74959]:       <target dev='tapf21d9813-77'/>
Nov 28 23:01:44 user nova-compute[74959]:       <model type='virtio'/>
Nov 28 23:01:44 user nova-compute[74959]:       <mtu size='1442'/>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='net1'/>
Nov 28 23:01:44 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </interface>
Nov 28 23:01:44 user nova-compute[74959]:     <serial type='pty'>
Nov 28 23:01:44 user nova-compute[74959]:       <source path='/dev/pts/8'/>
Nov 28 23:01:44 user nova-compute[74959]:       <log file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log' append='off'/>
Nov 28 23:01:44 user nova-compute[74959]:       <target type='isa-serial' port='0'>
Nov 28 23:01:44 user nova-compute[74959]:         <model name='isa-serial'/>
Nov 28 23:01:44 user nova-compute[74959]:       </target>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='serial0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </serial>
Nov 28 23:01:44 user nova-compute[74959]:     <console type='pty' tty='/dev/pts/8'>
Nov 28 23:01:44 user nova-compute[74959]:       <source path='/dev/pts/8'/>
Nov 28 23:01:44 user nova-compute[74959]:       <log file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log' append='off'/>
Nov 28 23:01:44 user nova-compute[74959]:       <target type='serial' port='0'/>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='serial0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </console>
Nov 28 23:01:44 user nova-compute[74959]:     <input type='mouse' bus='ps2'>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='input0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </input>
Nov 28 23:01:44 user nova-compute[74959]:     <input type='keyboard' bus='ps2'>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='input1'/>
Nov 28 23:01:44 user nova-compute[74959]:     </input>
Nov 28 23:01:44 user nova-compute[74959]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 28 23:01:44 user nova-compute[74959]:       <listen type='address' address='0.0.0.0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </graphics>
Nov 28 23:01:44 user nova-compute[74959]:     <audio id='1' type='none'/>
Nov 28 23:01:44 user nova-compute[74959]:     <video>
Nov 28 23:01:44 user nova-compute[74959]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='video0'/>
Nov 28 23:01:44 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </video>
Nov 28 23:01:44 user nova-compute[74959]:     <memballoon model='virtio'>
Nov 28 23:01:44 user nova-compute[74959]:       <stats period='10'/>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='balloon0'/>
Nov 28 23:01:44 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </memballoon>
Nov 28 23:01:44 user nova-compute[74959]:     <rng model='virtio'>
Nov 28 23:01:44 user nova-compute[74959]:       <backend model='random'>/dev/urandom</backend>
Nov 28 23:01:44 user nova-compute[74959]:       <alias name='rng0'/>
Nov 28 23:01:44 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 23:01:44 user nova-compute[74959]:     </rng>
Nov 28 23:01:44 user nova-compute[74959]:   </devices>
Nov 28 23:01:44 user nova-compute[74959]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 23:01:44 user nova-compute[74959]:     <label>libvirt-6c504232-f516-4764-8df1-7bff0a3bd413</label>
Nov 28 23:01:44 user nova-compute[74959]:     <imagelabel>libvirt-6c504232-f516-4764-8df1-7bff0a3bd413</imagelabel>
Nov 28 23:01:44 user nova-compute[74959]:   </seclabel>
Nov 28 23:01:44 user nova-compute[74959]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 23:01:44 user nova-compute[74959]:     <label>+64055:+108</label>
Nov 28 23:01:44 user nova-compute[74959]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 23:01:44 user nova-compute[74959]:   </seclabel>
Nov 28 23:01:44 user nova-compute[74959]: </domain>
Nov 28 23:01:44 user nova-compute[74959]:  {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 23:01:44 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Successfully detached device tapf21d9813-77 from instance 6c504232-f516-4764-8df1-7bff0a3bd413 from the persistent domain config.
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] (1/8): Attempting to detach device tapf21d9813-77 with device alias net1 from instance 6c504232-f516-4764-8df1-7bff0a3bd413 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] detach device xml: <interface type="ethernet">
Nov 28 23:01:44 user nova-compute[74959]:   <mac address="fa:16:3e:a6:16:6d"/>
Nov 28 23:01:44 user nova-compute[74959]:   <model type="virtio"/>
Nov 28 23:01:44 user nova-compute[74959]:   <mtu size="1442"/>
Nov 28 23:01:44 user nova-compute[74959]:   <target dev="tapf21d9813-77"/>
Nov 28 23:01:44 user nova-compute[74959]: </interface>
Nov 28 23:01:44 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Start waiting for the detach event from libvirt for device tapf21d9813-77 with device alias net1 for instance 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:01:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lazy-loading 'flavor' on Instance uuid 17495411-b15b-4660-b2fe-42749b11ed49 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b90b14b7-43fc-42c6-8d28-617228072a14 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.940s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-c3c5959f-9cdd-427a-9201-3c9d987fa00d req-2a76c764-cc49-4808-b18c-b6cb0c6a4ef3 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-unplugged-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c3c5959f-9cdd-427a-9201-3c9d987fa00d req-2a76c764-cc49-4808-b18c-b6cb0c6a4ef3 service nova] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c3c5959f-9cdd-427a-9201-3c9d987fa00d req-2a76c764-cc49-4808-b18c-b6cb0c6a4ef3 service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c3c5959f-9cdd-427a-9201-3c9d987fa00d req-2a76c764-cc49-4808-b18c-b6cb0c6a4ef3 service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-c3c5959f-9cdd-427a-9201-3c9d987fa00d req-2a76c764-cc49-4808-b18c-b6cb0c6a4ef3 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] No waiting events found dispatching network-vif-unplugged-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:45 user nova-compute[74959]: WARNING nova.compute.manager [req-c3c5959f-9cdd-427a-9201-3c9d987fa00d req-2a76c764-cc49-4808-b18c-b6cb0c6a4ef3 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received unexpected event network-vif-unplugged-f21d9813-7728-4e0b-b624-604cc413dc12 for instance with vm_state active and task_state None.
Nov 28 23:01:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:45 user nova-compute[74959]: INFO nova.compute.manager [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Terminating instance
Nov 28 23:01:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:46 user nova-compute[74959]: INFO nova.compute.manager [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Terminating instance
Nov 28 23:01:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-ab3cc391-7608-4199-b76e-c579a33476d2 req-1cbb1d5c-8cba-460c-b85e-980c0ce687c4 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ab3cc391-7608-4199-b76e-c579a33476d2 req-1cbb1d5c-8cba-460c-b85e-980c0ce687c4 service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ab3cc391-7608-4199-b76e-c579a33476d2 req-1cbb1d5c-8cba-460c-b85e-980c0ce687c4 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ab3cc391-7608-4199-b76e-c579a33476d2 req-1cbb1d5c-8cba-460c-b85e-980c0ce687c4 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-ab3cc391-7608-4199-b76e-c579a33476d2 req-1cbb1d5c-8cba-460c-b85e-980c0ce687c4 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-unplugged-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-ab3cc391-7608-4199-b76e-c579a33476d2 req-1cbb1d5c-8cba-460c-b85e-980c0ce687c4 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-77780988-92a8-4524-96bf-e9b8a8420e13 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-0cc1ebaa-667a-48c7-abdb-75b68fe11f3f req-bd207690-f8c3-41c0-90d2-2d1747c7123e service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0cc1ebaa-667a-48c7-abdb-75b68fe11f3f req-bd207690-f8c3-41c0-90d2-2d1747c7123e service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0cc1ebaa-667a-48c7-abdb-75b68fe11f3f req-bd207690-f8c3-41c0-90d2-2d1747c7123e service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0cc1ebaa-667a-48c7-abdb-75b68fe11f3f req-bd207690-f8c3-41c0-90d2-2d1747c7123e service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-0cc1ebaa-667a-48c7-abdb-75b68fe11f3f req-bd207690-f8c3-41c0-90d2-2d1747c7123e service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-unplugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-0cc1ebaa-667a-48c7-abdb-75b68fe11f3f req-bd207690-f8c3-41c0-90d2-2d1747c7123e service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] No waiting events found dispatching network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:47 user nova-compute[74959]: WARNING nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received unexpected event network-vif-plugged-f21d9813-7728-4e0b-b624-604cc413dc12 for instance with vm_state active and task_state None.
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-unplugged-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-16be754f-128d-42bb-9e0b-f8109e822537 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:47 user nova-compute[74959]: WARNING nova.compute.manager [req-917b1d1d-1571-46c9-bb58-7bde74c56cff req-348b26ac-ade6-43cb-811b-48bf2b072cc9 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-16be754f-128d-42bb-9e0b-f8109e822537 for instance with vm_state active and task_state deleting.
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Instance destroyed successfully.
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lazy-loading 'resources' on Instance uuid 17495411-b15b-4660-b2fe-42749b11ed49 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-7130657',display_name='tempest-AttachSCSIVolumeTestJSON-server-7130657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-7130657',id=8,image_ref='b4934419-54c6-47bc-8402-8145f283d1f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6xT2ZvE/cUZ0LEetkP3rD6pidYf6WyPgqDUtJuUaC8L2QTQh5I6kVw2z86NLmL/7OQvdC2Rz7/zd1wJOGxp9YhE/s31YFW9cfnZj/JYu9XWPbntKxxkyWh3dPo47VaGg==',key_name='tempest-keypair-744859541',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe553fd34cd94f2b9b1df89edb8a75af',ramdisk_id='',reservation_id='r-8kz4w0oy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4934419-54c6-47bc-8402-8145f283d1f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1085168283',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1085168283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0454c25fc7a643f39d57bf47c178c19b',uuid=17495411-b15b-4660-b2fe-42749b11ed49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Converting VIF {"id": "2b663438-3f9d-4bbf-aabf-e321f898662d", "address": "fa:16:3e:ec:ab:da", "network": {"id": "92c963b3-4071-4ffa-a1ae-724968bfb820", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-690130869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe553fd34cd94f2b9b1df89edb8a75af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b663438-3f", "ovs_interfaceid": "2b663438-3f9d-4bbf-aabf-e321f898662d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:da,bridge_name='br-int',has_traffic_filtering=True,id=2b663438-3f9d-4bbf-aabf-e321f898662d,network=Network(92c963b3-4071-4ffa-a1ae-724968bfb820),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b663438-3f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG os_vif [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:da,bridge_name='br-int',has_traffic_filtering=True,id=2b663438-3f9d-4bbf-aabf-e321f898662d,network=Network(92c963b3-4071-4ffa-a1ae-724968bfb820),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b663438-3f') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b663438-3f, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a2a51b5-a024-4f0f-8593-db2e6e88a62c) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: INFO os_vif [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:ab:da,bridge_name='br-int',has_traffic_filtering=True,id=2b663438-3f9d-4bbf-aabf-e321f898662d,network=Network(92c963b3-4071-4ffa-a1ae-724968bfb820),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b663438-3f')
Nov 28 23:01:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Deleting instance files /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49_del
Nov 28 23:01:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Deletion of /opt/stack/data/nova/instances/17495411-b15b-4660-b2fe-42749b11ed49_del complete
Nov 28 23:01:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Instance destroyed successfully.
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lazy-loading 'resources' on Instance uuid 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "address": "fa:16:3e:d9:91:67", "network": {"id": "f307cfd0-85ad-4016-8def-253dbd765bfa", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-520104235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b5b8018-59", "ovs_interfaceid": "9b5b8018-5907-4de7-8843-9486b57ab8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:91:67,bridge_name='br-int',has_traffic_filtering=True,id=9b5b8018-5907-4de7-8843-9486b57ab8e8,network=Network(f307cfd0-85ad-4016-8def-253dbd765bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5b8018-59') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:91:67,bridge_name='br-int',has_traffic_filtering=True,id=9b5b8018-5907-4de7-8843-9486b57ab8e8,network=Network(f307cfd0-85ad-4016-8def-253dbd765bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5b8018-59') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b5b8018-59, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:47 user nova-compute[74959]: INFO nova.compute.manager [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 28 23:01:47 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:01:47 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f37b8c48-f6ff-47c9-8689-cbb08d8c3c9e) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: INFO os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:91:67,bridge_name='br-int',has_traffic_filtering=True,id=9b5b8018-5907-4de7-8843-9486b57ab8e8,network=Network(f307cfd0-85ad-4016-8def-253dbd765bfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b5b8018-59')
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=9f29a5d6-1528-4d78-a307-071b8f187b89,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f29a5d6-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=9f29a5d6-1528-4d78-a307-071b8f187b89,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f29a5d6-15') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f29a5d6-15, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68610231-30fc-4ea8-bd90-7bd4cf5942b7) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: INFO os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:bd:15,bridge_name='br-int',has_traffic_filtering=True,id=9f29a5d6-1528-4d78-a307-071b8f187b89,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f29a5d6-15')
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:55:5b,bridge_name='br-int',has_traffic_filtering=True,id=77780988-92a8-4524-96bf-e9b8a8420e13,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77780988-92') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:55:5b,bridge_name='br-int',has_traffic_filtering=True,id=77780988-92a8-4524-96bf-e9b8a8420e13,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77780988-92') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77780988-92, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de1abf71-ce76-4aea-8c36-c6b93a1542b6) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: INFO os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:55:5b,bridge_name='br-int',has_traffic_filtering=True,id=77780988-92a8-4524-96bf-e9b8a8420e13,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap77780988-92')
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:d0,bridge_name='br-int',has_traffic_filtering=True,id=16be754f-128d-42bb-9e0b-f8109e822537,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16be754f-12') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:d0,bridge_name='br-int',has_traffic_filtering=True,id=16be754f-128d-42bb-9e0b-f8109e822537,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16be754f-12') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16be754f-12, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: WARNING nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-77780988-92a8-4524-96bf-e9b8a8420e13 for instance with vm_state active and task_state deleting.
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-unplugged-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-5de45185-2b05-4a71-9c0a-da897f1567a6 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: WARNING nova.compute.manager [req-3df2d47d-4141-454d-9e5a-4615f669d2ef req-a1eda665-1b62-4d3e-89d5-14b46b0eff7a service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-5de45185-2b05-4a71-9c0a-da897f1567a6 for instance with vm_state active and task_state deleting.
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9af600f-5000-4833-8a51-36cb1a3f4716) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: INFO os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:d0,bridge_name='br-int',has_traffic_filtering=True,id=16be754f-128d-42bb-9e0b-f8109e822537,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16be754f-12')
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:10:07,bridge_name='br-int',has_traffic_filtering=True,id=ea1a1907-61d6-4b6d-82cf-69c2cf228e37,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1a1907-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:10:07,bridge_name='br-int',has_traffic_filtering=True,id=ea1a1907-61d6-4b6d-82cf-69c2cf228e37,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1a1907-61') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea1a1907-61, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f3ac1dc-4081-401e-afd0-3b297bc96d05) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: INFO os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:10:07,bridge_name='br-int',has_traffic_filtering=True,id=ea1a1907-61d6-4b6d-82cf-69c2cf228e37,network=Network(f578d973-a894-42d9-95d5-2d16777d5b93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1a1907-61')
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:f8,bridge_name='br-int',has_traffic_filtering=True,id=695be666-a837-4bd3-bd97-88e22aeec0db,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695be666-a8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:f8,bridge_name='br-int',has_traffic_filtering=True,id=695be666-a837-4bd3-bd97-88e22aeec0db,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695be666-a8') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap695be666-a8, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: WARNING nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-9b5b8018-5907-4de7-8843-9486b57ab8e8 for instance with vm_state active and task_state deleting.
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-unplugged-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-9f29a5d6-1528-4d78-a307-071b8f187b89 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: WARNING nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-9f29a5d6-1528-4d78-a307-071b8f187b89 for instance with vm_state active and task_state deleting.
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-unplugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: WARNING nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 for instance with vm_state active and task_state deleting.
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received event network-vif-unplugged-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] No waiting events found dispatching network-vif-unplugged-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received event network-vif-unplugged-2b663438-3f9d-4bbf-aabf-e321f898662d for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received event network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Acquiring lock "17495411-b15b-4660-b2fe-42749b11ed49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "17495411-b15b-4660-b2fe-42749b11ed49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] No waiting events found dispatching network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: WARNING nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received unexpected event network-vif-plugged-2b663438-3f9d-4bbf-aabf-e321f898662d for instance with vm_state active and task_state deleting.
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-unplugged-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-1fd96445-f9e1-4c2e-a036-af4e5678bb75 req-b5b25865-5bb3-443f-bdf8-b220f3cadd2d service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-unplugged-695be666-a837-4bd3-bd97-88e22aeec0db for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=964a16b6-904f-45ac-9706-22f4bb371cf5) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: INFO os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:19:f8,bridge_name='br-int',has_traffic_filtering=True,id=695be666-a837-4bd3-bd97-88e22aeec0db,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap695be666-a8')
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936747039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936747039',id=12,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuNHyWqIROPI1xf0Y90IKjORJr2PhXStgilMVj4xCA1fmjdg06cNLncVE0lreKjJmer0drn1WAwIED+DxklObUIVMGzSDBfqyrbu46H2M3PUH8vt+vn6o+p19tOgjp6kg==',key_name='tempest-keypair-1825538129',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d33e0d58accb48f3ac6d76cf67785665',ramdisk_id='',reservation_id='r-uj0igi3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-902213869',owner_user_name='tempest-TaggedBootDevicesTest_v242-902213869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c7b3a0f45fc4541921ff54450dca885',uuid=9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converting VIF {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=5de45185-2b05-4a71-9c0a-da897f1567a6,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de45185-2b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=5de45185-2b05-4a71-9c0a-da897f1567a6,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de45185-2b') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5de45185-2b, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b413dcb-930e-4213-b82f-fa59df9eae11) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:48 user nova-compute[74959]: INFO os_vif [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:85,bridge_name='br-int',has_traffic_filtering=True,id=5de45185-2b05-4a71-9c0a-da897f1567a6,network=Network(1681ed92-0edf-4fe3-9dcf-497e3bff586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de45185-2b')
Nov 28 23:01:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AosnWKgI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:48 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b3d8b8-1490-43f5-817a-b821df71131c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:48 user nova-compute[74959]: No targets found.
Nov 28 23:01:48 user nova-compute[74959]: iSNS:
Nov 28 23:01:48 user nova-compute[74959]: No targets found.
Nov 28 23:01:48 user nova-compute[74959]: STATIC:
Nov 28 23:01:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c
Nov 28 23:01:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6
Nov 28 23:01:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441
Nov 28 23:01:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:48 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:48 user nova-compute[74959]: No targets found.
Nov 28 23:01:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:48 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:48 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2545dd-bfc5-4b97-a128-165ea5641c30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[601464d4-4b05-4362-b6e0-6767969a929f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:48 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef42ead40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6'): ({'sdc'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Removing single pathed devices sdc {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecb0447-6b2f-43af-8343-05dbcda5c58a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6464e9ef-05ac-400a-a4ca-89a2a7278400]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Flushing IO for device /dev/sdc {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc093d6-bfbc-40db-b638-b0cdecd16aa5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f047701-446a-4b29-82aa-0fa946de450b]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a47a82-5e5f-4fda-b7d9-67497777030f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e3f9c3-7e83-4175-beac-7efd2ef60564]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6, portal: 172.16.0.220,3260]
Nov 28 23:01:49 user nova-compute[74959]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26dd1e01-f6b5-4b6d-9050-2fafd3afa1f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6d9425-bd34-42e9-8224-1b631d76f0f5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== disconnect_volume: return (337ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HZkUsQbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:49 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad25cf89-fec4-416f-bd7e-59b5c5e0c0f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:49 user nova-compute[74959]: No targets found.
Nov 28 23:01:49 user nova-compute[74959]: iSNS:
Nov 28 23:01:49 user nova-compute[74959]: No targets found.
Nov 28 23:01:49 user nova-compute[74959]: STATIC:
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:49 user nova-compute[74959]: No targets found.
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:49 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:49 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee67a83-159f-4e4e-be6e-598c65a5f161]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c0468-73da-43dd-b149-4b39ccbc6f61]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4742dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[02257da3-ab0e-4036-a140-33026dd252fa]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac740f0-9912-4aef-b6f2-7788e415c3db]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b8af62-ac6e-4613-93ab-9b61815cae96]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Took 1.43 seconds to deallocate network for instance.
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f58ffd-f32d-4640-b76e-71dbee07c7aa]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d3646-a692-4f05-b8b9-af395c564d7f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-2232abb9-ac40-4fbc-9604-bdf1352f7683 req-6f7319c4-0fca-4c39-bb5e-7d106ff5d051 service nova] [instance: 17495411-b15b-4660-b2fe-42749b11ed49] Received event network-vif-deleted-2b663438-3f9d-4bbf-aabf-e321f898662d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae792765-b74d-45f0-9f71-cfad510ae8c1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441, portal: 172.16.0.220,3260]
Nov 28 23:01:49 user nova-compute[74959]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dea671a-a203-4b61-a173-255882c76441 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5ff4d-1b78-4dc7-bb13-bab39c72db30]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== disconnect_volume: return (366ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MaTOBwtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:49 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[078a2cce-dcb0-4a27-97b0-c009ac86f327]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:49 user nova-compute[74959]: No targets found.
Nov 28 23:01:49 user nova-compute[74959]: iSNS:
Nov 28 23:01:49 user nova-compute[74959]: No targets found.
Nov 28 23:01:49 user nova-compute[74959]: STATIC:
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:49 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:49 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:49 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:49 user nova-compute[74959]: No targets found.
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:49 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:49 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d041da3-da36-48a0-b2fd-e006ed570324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf6c104-e140-4d2a-af02-ef8768cff1db]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:49 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc79a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c'): ({'sdd'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Removing single pathed devices sdd {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83f78a1-1d59-4dd3-88f1-29bd61b6ffb3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6588651a-8081-44d4-84e1-54a0d8abf656]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Flushing IO for device /dev/sdd {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bae1418-47bd-4f24-95db-cfbe325e5e22]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e6a00-ea32-4c7c-9777-f2611c011c35]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ecad9f-5f1f-4580-8ea6-9c2f9c74f16a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:49 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Deleted allocations for instance 17495411-b15b-4660-b2fe-42749b11ed49
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[70682ca3-3cad-4e67-9111-0e7c8beb6f91]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c, portal: 172.16.0.220,3260]
Nov 28 23:01:49 user nova-compute[74959]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd287388-5802-471c-ac44-075a1a703a8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7afbcc-89bc-4236-83eb-ff78d16dcbf2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] <== disconnect_volume: return (345ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:01:49 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Deleting instance files /opt/stack/data/nova/instances/9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1_del
Nov 28 23:01:49 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Deletion of /opt/stack/data/nova/instances/9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1_del complete
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14def192-4dd1-4d00-a945-e52e8b67a8b2 tempest-AttachSCSIVolumeTestJSON-1085168283 tempest-AttachSCSIVolumeTestJSON-1085168283-project-member] Lock "17495411-b15b-4660-b2fe-42749b11ed49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.571s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:49 user nova-compute[74959]: INFO nova.compute.manager [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Took 4.18 seconds to destroy the instance on the hypervisor.
Nov 28 23:01:49 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:01:49 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:01:50 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d0d20108-9362-4586-9d9d-88522ce58ad7 is timed out.
Nov 28 23:01:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Successfully detached device vdb from instance d0d20108-9362-4586-9d9d-88522ce58ad7 from the live domain config.
Nov 28 23:01:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZLbMPao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:50 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cbe903-cc29-4636-a197-b32f87fd2007]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:50 user nova-compute[74959]: No targets found.
Nov 28 23:01:50 user nova-compute[74959]: iSNS:
Nov 28 23:01:50 user nova-compute[74959]: No targets found.
Nov 28 23:01:50 user nova-compute[74959]: STATIC:
Nov 28 23:01:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91
Nov 28 23:01:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:50 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:50 user nova-compute[74959]: No targets found.
Nov 28 23:01:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:50 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:50 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2026eeb-54af-4f30-b586-5ff1ba50a979]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ab7c04-f031-409d-9bc4-23ea00e9d871]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:50 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:50 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:50 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 (non-flash)
Nov 28 23:01:50 user nova-compute[74959]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:50 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:50 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef47e6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91'): ({'sdk'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Removing single pathed devices sdk {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bd09ca-a790-46c1-9398-6352e2ab504f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeae6c8-7837-41fd-9359-128073301edc]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Flushing IO for device /dev/sdk {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-38b3c197-c113-48b9-b4a0-8dcd031e7144 req-c7d051cc-995f-419f-bfe3-7f76a4aeb684 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-38b3c197-c113-48b9-b4a0-8dcd031e7144 req-c7d051cc-995f-419f-bfe3-7f76a4aeb684 service nova] Acquiring lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-38b3c197-c113-48b9-b4a0-8dcd031e7144 req-c7d051cc-995f-419f-bfe3-7f76a4aeb684 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-38b3c197-c113-48b9-b4a0-8dcd031e7144 req-c7d051cc-995f-419f-bfe3-7f76a4aeb684 service nova] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-38b3c197-c113-48b9-b4a0-8dcd031e7144 req-c7d051cc-995f-419f-bfe3-7f76a4aeb684 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] No waiting events found dispatching network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:01:50 user nova-compute[74959]: WARNING nova.compute.manager [req-38b3c197-c113-48b9-b4a0-8dcd031e7144 req-c7d051cc-995f-419f-bfe3-7f76a4aeb684 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received unexpected event network-vif-plugged-695be666-a837-4bd3-bd97-88e22aeec0db for instance with vm_state active and task_state deleting.
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e02a9-9336-41d5-8ad8-a82c11c79608]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.052s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db0d482-d6da-4baf-b185-586cf4d5b177]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] SCSI volumes sdk have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19157f8-82a5-44af-b82c-6897a27b0a92]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd5c32-c273-41db-9b8f-0328c3b512e8]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91, portal: 172.16.0.220,3260]
Nov 28 23:01:50 user nova-compute[74959]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ca79c5-8bf8-40f2-b8d3-942d4ac5ff91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0538e4c7-7772-4927-b106-d7bea4d231ff]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] <== disconnect_volume: return (340ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:01:51 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lazy-loading 'flavor' on Instance uuid d0d20108-9362-4586-9d9d-88522ce58ad7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d878301b-87dc-4c51-b45f-d89e90e28f7f tempest-VolumesAssistedSnapshotsTest-750484638 tempest-VolumesAssistedSnapshotsTest-750484638-project-admin] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-a0605016-8b1c-49e5-9333-f77d63223846 req-ab615018-942e-44bb-8933-a44d019ea40e service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-deleted-9b5b8018-5907-4de7-8843-9486b57ab8e8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:52 user nova-compute[74959]: INFO nova.compute.manager [req-a0605016-8b1c-49e5-9333-f77d63223846 req-ab615018-942e-44bb-8933-a44d019ea40e service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Neutron deleted interface 9b5b8018-5907-4de7-8843-9486b57ab8e8; detaching it from the instance and deleting it from the info cache
Nov 28 23:01:52 user nova-compute[74959]: DEBUG nova.network.neutron [req-a0605016-8b1c-49e5-9333-f77d63223846 req-ab615018-942e-44bb-8933-a44d019ea40e service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [{"id": "9f29a5d6-1528-4d78-a307-071b8f187b89", "address": "fa:16:3e:a0:bd:15", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f29a5d6-15", "ovs_interfaceid": "9f29a5d6-1528-4d78-a307-071b8f187b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77780988-92a8-4524-96bf-e9b8a8420e13", "address": "fa:16:3e:da:55:5b", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77780988-92", "ovs_interfaceid": "77780988-92a8-4524-96bf-e9b8a8420e13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16be754f-128d-42bb-9e0b-f8109e822537", "address": "fa:16:3e:6d:56:d0", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16be754f-12", "ovs_interfaceid": "16be754f-128d-42bb-9e0b-f8109e822537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "address": "fa:16:3e:b3:10:07", "network": {"id": "f578d973-a894-42d9-95d5-2d16777d5b93", "bridge": "br-int", "label": "tempest-device-tagging-net1-1624479929", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1a1907-61", "ovs_interfaceid": "ea1a1907-61d6-4b6d-82cf-69c2cf228e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "695be666-a837-4bd3-bd97-88e22aeec0db", "address": "fa:16:3e:89:19:f8", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap695be666-a8", "ovs_interfaceid": "695be666-a837-4bd3-bd97-88e22aeec0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5de45185-2b05-4a71-9c0a-da897f1567a6", "address": "fa:16:3e:14:b1:85", "network": {"id": "1681ed92-0edf-4fe3-9dcf-497e3bff586a", "bridge": "br-int", "label": "tempest-device-tagging-net2-215789456", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d33e0d58accb48f3ac6d76cf67785665", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de45185-2b", "ovs_interfaceid": "5de45185-2b05-4a71-9c0a-da897f1567a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-a0605016-8b1c-49e5-9333-f77d63223846 req-ab615018-942e-44bb-8933-a44d019ea40e service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Detach interface failed, port_id=9b5b8018-5907-4de7-8843-9486b57ab8e8, reason: Instance 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab7dbb0e-6b7e-4250-b0b9-23307c335494', 'attached_at': '', 'detached_at': '', 'volume_id': '24ca1a51-2325-440a-bb07-c369e72aa523', 'serial': '24ca1a51-2325-440a-bb07-c369e72aa523'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZoxkTEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '69aadf45-fb0d-4764-90e2-724b5144bd23'}, 'status': 'reserved', 'instance': 'ab7dbb0e-6b7e-4250-b0b9-23307c335494', 'attached_at': '', 'detached_at': '', 'volume_id': '69aadf45-fb0d-4764-90e2-724b5144bd23', 'serial'} {{(pid=74959) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:52 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:52 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:52 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[844e38e6-8328-489e-b079-b905d2501b51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:01:52 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6512247-5e4e-4019-b6af-6d841131d54e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523] added
Nov 28 23:01:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[897518df-bf0a-40bb-80e4-a3aa7b2436da]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[21faa16c-543b-48e0-9212-2f4b9619b382]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opNVMKWQ {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opNVMKWQ" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc7912-a68a-4431-9204-c0d1aa1570fc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opNVMKWQ'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b44136-7056-4075-b788-b9062d4b6836]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aabc8e9-22c8-4044-8d84-d968084e3b1a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f173b3c9-c73c-42ea-98a4-e5572b9764dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260]
Nov 28 23:01:52 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260] successful.
Nov 28 23:01:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e34feb9-e0c5-4663-9cab-5eec2f124f6c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ae4cbf-9db1-4f44-9880-ac209e86fc00]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:52 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[428d11ed-7af4-4c48-843f-7669a1b51858]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:53 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:01:53 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Took 3.35 seconds to deallocate network for instance.
Nov 28 23:01:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:01:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:01:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:01:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26534656433653734', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:01:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534656433653734', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:01:53 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lazy-loading 'flavor' on Instance uuid ab7dbb0e-6b7e-4250-b0b9-23307c335494 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:01:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:01:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-9bd5d714-7fb6-4266-a411-30c5156fbc95 req-b5d0603a-d2a3-4cb2-99dc-ab81e56c9556 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-deleted-695be666-a837-4bd3-bd97-88e22aeec0db {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-9bd5d714-7fb6-4266-a411-30c5156fbc95 req-b5d0603a-d2a3-4cb2-99dc-ab81e56c9556 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-deleted-16be754f-128d-42bb-9e0b-f8109e822537 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-9bd5d714-7fb6-4266-a411-30c5156fbc95 req-b5d0603a-d2a3-4cb2-99dc-ab81e56c9556 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-deleted-ea1a1907-61d6-4b6d-82cf-69c2cf228e37 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-9bd5d714-7fb6-4266-a411-30c5156fbc95 req-b5d0603a-d2a3-4cb2-99dc-ab81e56c9556 service nova] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Received event network-vif-deleted-5de45185-2b05-4a71-9c0a-da897f1567a6 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:01:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 38797312 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 50331648 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 162529280 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 289406976 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 369098752 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 512753664 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:57 user nova-compute[74959]: INFO nova.compute.manager [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] [instance: 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1] Took 3.91 seconds to detach 3 volumes for instance.
Nov 28 23:01:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:01:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:01:57 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:01:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 625999872 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:57 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:01:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:57 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Deleted allocations for instance 9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1
Nov 28 23:01:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29d28b0d-9346-46cc-9863-ed9b00124335 tempest-TaggedBootDevicesTest_v242-902213869 tempest-TaggedBootDevicesTest_v242-902213869-project-member] Lock "9664b9fc-eaa5-4d2f-94cb-65d9e415b4a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.173s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:01:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 741343232 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 957349888 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZoxkTEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '69aadf45-fb0d-4764-90e2-724b5144bd23'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:01:59 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a454c5e9-8677-46fc-b77f-9592c29ecce3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:01:59 user nova-compute[74959]: No targets found.
Nov 28 23:01:59 user nova-compute[74959]: iSNS:
Nov 28 23:01:59 user nova-compute[74959]: No targets found.
Nov 28 23:01:59 user nova-compute[74959]: STATIC:
Nov 28 23:01:59 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:01:59 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:59 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:59 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523
Nov 28 23:01:59 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:59 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:59 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:01:59 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:59 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:59 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23
Nov 28 23:01:59 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:01:59 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:01:59 user nova-compute[74959]: FIRMWARE:
Nov 28 23:01:59 user nova-compute[74959]: No targets found.
Nov 28 23:01:59 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:01:59 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:01:59 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4ccf11-aee7-4940-85ea-529336074f97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2bfa0a-6604-4bac-ba12-92561bccc23b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:59 user nova-compute[74959]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:59 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:59 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:59 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 (non-flash)
Nov 28 23:01:59 user nova-compute[74959]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:01:59 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:01:59 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:01:59 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef47e7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23'): ({'sdl'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Removing single pathed devices sdl {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d7822-d5b7-416a-898a-a7a2656663ec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0423f19a-60ee-4b14-84ba-f463edb2167e]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Flushing IO for device /dev/sdl {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a2d54-04a8-4ca1-8899-a509b2cf8a7c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad947e6-f94d-44e4-9559-a746218f149d]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] SCSI volumes sdl have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:01:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8ac04f-3b21-4019-9798-f43a6088bcb0]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31df4da-8db6-42b3-ab0f-e5edeef66c44]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23, portal: 172.16.0.220,3260]
Nov 28 23:02:00 user nova-compute[74959]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23, portal: 172.16.0.220,3260] successful.
Nov 28 23:02:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69aadf45-fb0d-4764-90e2-724b5144bd23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7471ae52-9c09-42c4-a1a1-ecb441f80671]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] <== disconnect_volume: return (326ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ab7dbb0e-6b7e-4250-b0b9-23307c335494', 'attached_at': '', 'detached_at': '', 'volume_id': '24ca1a51-2325-440a-bb07-c369e72aa523', 'serial'} {{(pid=74959) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] swap_volume: removing Cinder connection for volume 69aadf45-fb0d-4764-90e2-724b5144bd23 {{(pid=74959) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] swap_volume: Updating volume 69aadf45-fb0d-4764-90e2-724b5144bd23 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "opNVMKWQ", "auth_password": "dRMXNk6SGL3AlJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "24ca1a51-2325-440a-bb07-c369e72aa523"}, "status": "reserved", "instance": "ab7dbb0e-6b7e-4250-b0b9-23307c335494", "attached_at": "", "detached_at": "", "volume_id": "24ca1a51-2325-440a-bb07-c369e72aa523", "serial": "24ca1a51-2325-440a-bb07-c369e72aa523"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '24ca1a51-2325-440a-bb07-c369e72aa523', 'no_device': None, 'attachment_id': '435f3633-e429-47ef-9995-3e84f8cb0b03'} {{(pid=74959) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 23:02:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ebbc1d9e-7cf5-45cd-a4bd-faf02aa2a8d3 tempest-TestVolumeSwap-1750484314 tempest-TestVolumeSwap-1750484314-project-admin] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.419s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:02 user nova-compute[74959]: INFO nova.compute.manager [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Detaching volume 24ca1a51-2325-440a-bb07-c369e72aa523
Nov 28 23:02:02 user nova-compute[74959]: INFO nova.virt.block_device [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Attempting to driver detach volume 24ca1a51-2325-440a-bb07-c369e72aa523 from mountpoint /dev/vdb
Nov 28 23:02:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Attempting to detach device vdb from instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:02:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:02:02 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:02:02 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:02:02 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:02:02 user nova-compute[74959]:   <serial>24ca1a51-2325-440a-bb07-c369e72aa523</serial>
Nov 28 23:02:02 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:02:02 user nova-compute[74959]: </disk>
Nov 28 23:02:02 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:02:02 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Successfully detached device vdb from instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 from the persistent domain config.
Nov 28 23:02:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:02:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:02:02 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:02:02 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:02:02 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:02:02 user nova-compute[74959]:   <serial>24ca1a51-2325-440a-bb07-c369e72aa523</serial>
Nov 28 23:02:02 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:02:02 user nova-compute[74959]: </disk>
Nov 28 23:02:02 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:02:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:02:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:02:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:02:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:02:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:04 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Waiting for libvirt event about the detach of device tapf21d9813-77 with device alias net1 from instance 6c504232-f516-4764-8df1-7bff0a3bd413 is timed out.
Nov 28 23:02:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface> {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 28 23:02:04 user nova-compute[74959]:   <name>instance-00000009</name>
Nov 28 23:02:04 user nova-compute[74959]:   <uuid>6c504232-f516-4764-8df1-7bff0a3bd413</uuid>
Nov 28 23:02:04 user nova-compute[74959]:   <metadata>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:04 user nova-compute[74959]:   <nova:package version="0.0.0"/>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:name>tempest-device-tagging-server-536022995</nova:name>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:creationTime>2023-11-28 23:01:05</nova:creationTime>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:flavor name="m1.tiny">
Nov 28 23:02:04 user nova-compute[74959]:     <nova:memory>512</nova:memory>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:disk>1</nova:disk>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:swap>0</nova:swap>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:04 user nova-compute[74959]:   </nova:flavor>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:owner>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:user uuid="1ee17e5f07f04b31b55b3fa94c8cf8a5">tempest-TaggedAttachmentsTest-1971458541-project-member</nova:user>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:project uuid="01c3efd63364440eb53df04de34a01bc">tempest-TaggedAttachmentsTest-1971458541</nova:project>
Nov 28 23:02:04 user nova-compute[74959]:   </nova:owner>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:ports>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:port uuid="c3f3885d-8bb2-465b-a52f-b9ee64375c47">
Nov 28 23:02:04 user nova-compute[74959]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:02:04 user nova-compute[74959]:     </nova:port>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:port uuid="f21d9813-7728-4e0b-b624-604cc413dc12">
Nov 28 23:02:04 user nova-compute[74959]:       <nova:ip type="fixed" address="10.10.10.166" ipVersion="4"/>
Nov 28 23:02:04 user nova-compute[74959]:     </nova:port>
Nov 28 23:02:04 user nova-compute[74959]:   </nova:ports>
Nov 28 23:02:04 user nova-compute[74959]: </nova:instance>
Nov 28 23:02:04 user nova-compute[74959]:   </metadata>
Nov 28 23:02:04 user nova-compute[74959]:   <memory unit='KiB'>524288</memory>
Nov 28 23:02:04 user nova-compute[74959]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 23:02:04 user nova-compute[74959]:   <vcpu placement='static'>1</vcpu>
Nov 28 23:02:04 user nova-compute[74959]:   <resource>
Nov 28 23:02:04 user nova-compute[74959]:     <partition>/machine</partition>
Nov 28 23:02:04 user nova-compute[74959]:   </resource>
Nov 28 23:02:04 user nova-compute[74959]:   <sysinfo type='smbios'>
Nov 28 23:02:04 user nova-compute[74959]:     <system>
Nov 28 23:02:04 user nova-compute[74959]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 23:02:04 user nova-compute[74959]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 23:02:04 user nova-compute[74959]:       <entry name='version'>0.0.0</entry>
Nov 28 23:02:04 user nova-compute[74959]:       <entry name='serial'>6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 23:02:04 user nova-compute[74959]:       <entry name='uuid'>6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 23:02:04 user nova-compute[74959]:       <entry name='family'>Virtual Machine</entry>
Nov 28 23:02:04 user nova-compute[74959]:     </system>
Nov 28 23:02:04 user nova-compute[74959]:   </sysinfo>
Nov 28 23:02:04 user nova-compute[74959]:   <os>
Nov 28 23:02:04 user nova-compute[74959]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 23:02:04 user nova-compute[74959]:     <boot dev='hd'/>
Nov 28 23:02:04 user nova-compute[74959]:     <smbios mode='sysinfo'/>
Nov 28 23:02:04 user nova-compute[74959]:   </os>
Nov 28 23:02:04 user nova-compute[74959]:   <features>
Nov 28 23:02:04 user nova-compute[74959]:     <acpi/>
Nov 28 23:02:04 user nova-compute[74959]:     <apic/>
Nov 28 23:02:04 user nova-compute[74959]:     <vmcoreinfo state='on'/>
Nov 28 23:02:04 user nova-compute[74959]:   </features>
Nov 28 23:02:04 user nova-compute[74959]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 23:02:04 user nova-compute[74959]:     <model fallback='forbid'>Nehalem</model>
Nov 28 23:02:04 user nova-compute[74959]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 23:02:04 user nova-compute[74959]:     <feature policy='require' name='vme'/>
Nov 28 23:02:04 user nova-compute[74959]:     <feature policy='require' name='x2apic'/>
Nov 28 23:02:04 user nova-compute[74959]:     <feature policy='require' name='hypervisor'/>
Nov 28 23:02:04 user nova-compute[74959]:   </cpu>
Nov 28 23:02:04 user nova-compute[74959]:   <clock offset='utc'>
Nov 28 23:02:04 user nova-compute[74959]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 23:02:04 user nova-compute[74959]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 23:02:04 user nova-compute[74959]:     <timer name='hpet' present='no'/>
Nov 28 23:02:04 user nova-compute[74959]:   </clock>
Nov 28 23:02:04 user nova-compute[74959]:   <on_poweroff>destroy</on_poweroff>
Nov 28 23:02:04 user nova-compute[74959]:   <on_reboot>restart</on_reboot>
Nov 28 23:02:04 user nova-compute[74959]:   <on_crash>destroy</on_crash>
Nov 28 23:02:04 user nova-compute[74959]:   <devices>
Nov 28 23:02:04 user nova-compute[74959]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 23:02:04 user nova-compute[74959]:     <disk type='file' device='disk'>
Nov 28 23:02:04 user nova-compute[74959]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 23:02:04 user nova-compute[74959]:       <source file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk' index='2'/>
Nov 28 23:02:04 user nova-compute[74959]:       <backingStore type='file' index='3'>
Nov 28 23:02:04 user nova-compute[74959]:         <format type='raw'/>
Nov 28 23:02:04 user nova-compute[74959]:         <source file='/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8'/>
Nov 28 23:02:04 user nova-compute[74959]:         <backingStore/>
Nov 28 23:02:04 user nova-compute[74959]:       </backingStore>
Nov 28 23:02:04 user nova-compute[74959]:       <target dev='vda' bus='virtio'/>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='virtio-disk0'/>
Nov 28 23:02:04 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </disk>
Nov 28 23:02:04 user nova-compute[74959]:     <disk type='file' device='cdrom'>
Nov 28 23:02:04 user nova-compute[74959]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 23:02:04 user nova-compute[74959]:       <source file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.config' index='1'/>
Nov 28 23:02:04 user nova-compute[74959]:       <backingStore/>
Nov 28 23:02:04 user nova-compute[74959]:       <target dev='hda' bus='ide'/>
Nov 28 23:02:04 user nova-compute[74959]:       <readonly/>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='ide0-0-0'/>
Nov 28 23:02:04 user nova-compute[74959]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </disk>
Nov 28 23:02:04 user nova-compute[74959]:     <controller type='usb' index='0' model='none'>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='usb'/>
Nov 28 23:02:04 user nova-compute[74959]:     </controller>
Nov 28 23:02:04 user nova-compute[74959]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='pci.0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </controller>
Nov 28 23:02:04 user nova-compute[74959]:     <controller type='ide' index='0'>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='ide'/>
Nov 28 23:02:04 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 23:02:04 user nova-compute[74959]:     </controller>
Nov 28 23:02:04 user nova-compute[74959]:     <interface type='ethernet'>
Nov 28 23:02:04 user nova-compute[74959]:       <mac address='fa:16:3e:84:4e:67'/>
Nov 28 23:02:04 user nova-compute[74959]:       <target dev='tapc3f3885d-8b'/>
Nov 28 23:02:04 user nova-compute[74959]:       <model type='virtio'/>
Nov 28 23:02:04 user nova-compute[74959]:       <mtu size='1442'/>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='net0'/>
Nov 28 23:02:04 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </interface>
Nov 28 23:02:04 user nova-compute[74959]:     <serial type='pty'>
Nov 28 23:02:04 user nova-compute[74959]:       <source path='/dev/pts/8'/>
Nov 28 23:02:04 user nova-compute[74959]:       <log file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log' append='off'/>
Nov 28 23:02:04 user nova-compute[74959]:       <target type='isa-serial' port='0'>
Nov 28 23:02:04 user nova-compute[74959]:         <model name='isa-serial'/>
Nov 28 23:02:04 user nova-compute[74959]:       </target>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='serial0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </serial>
Nov 28 23:02:04 user nova-compute[74959]:     <console type='pty' tty='/dev/pts/8'>
Nov 28 23:02:04 user nova-compute[74959]:       <source path='/dev/pts/8'/>
Nov 28 23:02:04 user nova-compute[74959]:       <log file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log' append='off'/>
Nov 28 23:02:04 user nova-compute[74959]:       <target type='serial' port='0'/>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='serial0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </console>
Nov 28 23:02:04 user nova-compute[74959]:     <input type='mouse' bus='ps2'>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='input0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </input>
Nov 28 23:02:04 user nova-compute[74959]:     <input type='keyboard' bus='ps2'>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='input1'/>
Nov 28 23:02:04 user nova-compute[74959]:     </input>
Nov 28 23:02:04 user nova-compute[74959]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 28 23:02:04 user nova-compute[74959]:       <listen type='address' address='0.0.0.0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </graphics>
Nov 28 23:02:04 user nova-compute[74959]:     <audio id='1' type='none'/>
Nov 28 23:02:04 user nova-compute[74959]:     <video>
Nov 28 23:02:04 user nova-compute[74959]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='video0'/>
Nov 28 23:02:04 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </video>
Nov 28 23:02:04 user nova-compute[74959]:     <memballoon model='virtio'>
Nov 28 23:02:04 user nova-compute[74959]:       <stats period='10'/>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='balloon0'/>
Nov 28 23:02:04 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </memballoon>
Nov 28 23:02:04 user nova-compute[74959]:     <rng model='virtio'>
Nov 28 23:02:04 user nova-compute[74959]:       <backend model='random'>/dev/urandom</backend>
Nov 28 23:02:04 user nova-compute[74959]:       <alias name='rng0'/>
Nov 28 23:02:04 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 23:02:04 user nova-compute[74959]:     </rng>
Nov 28 23:02:04 user nova-compute[74959]:   </devices>
Nov 28 23:02:04 user nova-compute[74959]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 23:02:04 user nova-compute[74959]:     <label>libvirt-6c504232-f516-4764-8df1-7bff0a3bd413</label>
Nov 28 23:02:04 user nova-compute[74959]:     <imagelabel>libvirt-6c504232-f516-4764-8df1-7bff0a3bd413</imagelabel>
Nov 28 23:02:04 user nova-compute[74959]:   </seclabel>
Nov 28 23:02:04 user nova-compute[74959]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 23:02:04 user nova-compute[74959]:     <label>+64055:+108</label>
Nov 28 23:02:04 user nova-compute[74959]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 23:02:04 user nova-compute[74959]:   </seclabel>
Nov 28 23:02:04 user nova-compute[74959]: </domain>
Nov 28 23:02:04 user nova-compute[74959]:  {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 23:02:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Successfully detached device tapf21d9813-77 from instance 6c504232-f516-4764-8df1-7bff0a3bd413 from the live domain config.
Nov 28 23:02:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converting VIF {"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG os_vif [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf21d9813-77, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5653ec87-8c3e-430e-9b66-dcedf5abf7d0) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:04 user nova-compute[74959]: INFO os_vif [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77')
Nov 28 23:02:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:04 user nova-compute[74959]:   <nova:package version="0.0.0"/>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:name>tempest-device-tagging-server-536022995</nova:name>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:creationTime>2023-11-28 23:02:04</nova:creationTime>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:flavor name="m1.tiny">
Nov 28 23:02:04 user nova-compute[74959]:     <nova:memory>512</nova:memory>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:disk>1</nova:disk>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:swap>0</nova:swap>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:04 user nova-compute[74959]:   </nova:flavor>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:owner>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:user uuid="1ee17e5f07f04b31b55b3fa94c8cf8a5">tempest-TaggedAttachmentsTest-1971458541-project-member</nova:user>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:project uuid="01c3efd63364440eb53df04de34a01bc">tempest-TaggedAttachmentsTest-1971458541</nova:project>
Nov 28 23:02:04 user nova-compute[74959]:   </nova:owner>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:02:04 user nova-compute[74959]:   <nova:ports>
Nov 28 23:02:04 user nova-compute[74959]:     <nova:port uuid="c3f3885d-8bb2-465b-a52f-b9ee64375c47">
Nov 28 23:02:04 user nova-compute[74959]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:02:04 user nova-compute[74959]:     </nova:port>
Nov 28 23:02:04 user nova-compute[74959]:   </nova:ports>
Nov 28 23:02:04 user nova-compute[74959]: </nova:instance>
Nov 28 23:02:04 user nova-compute[74959]:  {{(pid=74959) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-deleted-f21d9813-7728-4e0b-b624-604cc413dc12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:05 user nova-compute[74959]: INFO nova.compute.manager [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Neutron deleted interface f21d9813-7728-4e0b-b624-604cc413dc12; detaching it from the instance and deleting it from the info cache
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.network.neutron [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.objects.instance [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Lazy-loading 'system_metadata' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquired lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.objects.instance [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Lazy-loading 'flavor' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.objects.base [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Object Instance<6c504232-f516-4764-8df1-7bff0a3bd413> lazy-loaded attributes: system_metadata,flavor {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Converting VIF {"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface> {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 28 23:02:05 user nova-compute[74959]:   <name>instance-00000009</name>
Nov 28 23:02:05 user nova-compute[74959]:   <uuid>6c504232-f516-4764-8df1-7bff0a3bd413</uuid>
Nov 28 23:02:05 user nova-compute[74959]:   <metadata>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:05 user nova-compute[74959]:   <nova:package version="0.0.0"/>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:name>tempest-device-tagging-server-536022995</nova:name>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:creationTime>2023-11-28 23:02:04</nova:creationTime>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:flavor name="m1.tiny">
Nov 28 23:02:05 user nova-compute[74959]:     <nova:memory>512</nova:memory>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:disk>1</nova:disk>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:swap>0</nova:swap>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:flavor>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:owner>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:user uuid="1ee17e5f07f04b31b55b3fa94c8cf8a5">tempest-TaggedAttachmentsTest-1971458541-project-member</nova:user>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:project uuid="01c3efd63364440eb53df04de34a01bc">tempest-TaggedAttachmentsTest-1971458541</nova:project>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:owner>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:ports>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:port uuid="c3f3885d-8bb2-465b-a52f-b9ee64375c47">
Nov 28 23:02:05 user nova-compute[74959]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:02:05 user nova-compute[74959]:     </nova:port>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:ports>
Nov 28 23:02:05 user nova-compute[74959]: </nova:instance>
Nov 28 23:02:05 user nova-compute[74959]:   </metadata>
Nov 28 23:02:05 user nova-compute[74959]:   <memory unit='KiB'>524288</memory>
Nov 28 23:02:05 user nova-compute[74959]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 23:02:05 user nova-compute[74959]:   <vcpu placement='static'>1</vcpu>
Nov 28 23:02:05 user nova-compute[74959]:   <resource>
Nov 28 23:02:05 user nova-compute[74959]:     <partition>/machine</partition>
Nov 28 23:02:05 user nova-compute[74959]:   </resource>
Nov 28 23:02:05 user nova-compute[74959]:   <sysinfo type='smbios'>
Nov 28 23:02:05 user nova-compute[74959]:     <system>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='version'>0.0.0</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='serial'>6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='uuid'>6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='family'>Virtual Machine</entry>
Nov 28 23:02:05 user nova-compute[74959]:     </system>
Nov 28 23:02:05 user nova-compute[74959]:   </sysinfo>
Nov 28 23:02:05 user nova-compute[74959]:   <os>
Nov 28 23:02:05 user nova-compute[74959]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 23:02:05 user nova-compute[74959]:     <boot dev='hd'/>
Nov 28 23:02:05 user nova-compute[74959]:     <smbios mode='sysinfo'/>
Nov 28 23:02:05 user nova-compute[74959]:   </os>
Nov 28 23:02:05 user nova-compute[74959]:   <features>
Nov 28 23:02:05 user nova-compute[74959]:     <acpi/>
Nov 28 23:02:05 user nova-compute[74959]:     <apic/>
Nov 28 23:02:05 user nova-compute[74959]:     <vmcoreinfo state='on'/>
Nov 28 23:02:05 user nova-compute[74959]:   </features>
Nov 28 23:02:05 user nova-compute[74959]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 23:02:05 user nova-compute[74959]:     <model fallback='forbid'>Nehalem</model>
Nov 28 23:02:05 user nova-compute[74959]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 23:02:05 user nova-compute[74959]:     <feature policy='require' name='vme'/>
Nov 28 23:02:05 user nova-compute[74959]:     <feature policy='require' name='x2apic'/>
Nov 28 23:02:05 user nova-compute[74959]:     <feature policy='require' name='hypervisor'/>
Nov 28 23:02:05 user nova-compute[74959]:   </cpu>
Nov 28 23:02:05 user nova-compute[74959]:   <clock offset='utc'>
Nov 28 23:02:05 user nova-compute[74959]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 23:02:05 user nova-compute[74959]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 23:02:05 user nova-compute[74959]:     <timer name='hpet' present='no'/>
Nov 28 23:02:05 user nova-compute[74959]:   </clock>
Nov 28 23:02:05 user nova-compute[74959]:   <on_poweroff>destroy</on_poweroff>
Nov 28 23:02:05 user nova-compute[74959]:   <on_reboot>restart</on_reboot>
Nov 28 23:02:05 user nova-compute[74959]:   <on_crash>destroy</on_crash>
Nov 28 23:02:05 user nova-compute[74959]:   <devices>
Nov 28 23:02:05 user nova-compute[74959]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 23:02:05 user nova-compute[74959]:     <disk type='file' device='disk'>
Nov 28 23:02:05 user nova-compute[74959]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 23:02:05 user nova-compute[74959]:       <source file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk' index='2'/>
Nov 28 23:02:05 user nova-compute[74959]:       <backingStore type='file' index='3'>
Nov 28 23:02:05 user nova-compute[74959]:         <format type='raw'/>
Nov 28 23:02:05 user nova-compute[74959]:         <source file='/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8'/>
Nov 28 23:02:05 user nova-compute[74959]:         <backingStore/>
Nov 28 23:02:05 user nova-compute[74959]:       </backingStore>
Nov 28 23:02:05 user nova-compute[74959]:       <target dev='vda' bus='virtio'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='virtio-disk0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </disk>
Nov 28 23:02:05 user nova-compute[74959]:     <disk type='file' device='cdrom'>
Nov 28 23:02:05 user nova-compute[74959]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 23:02:05 user nova-compute[74959]:       <source file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.config' index='1'/>
Nov 28 23:02:05 user nova-compute[74959]:       <backingStore/>
Nov 28 23:02:05 user nova-compute[74959]:       <target dev='hda' bus='ide'/>
Nov 28 23:02:05 user nova-compute[74959]:       <readonly/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='ide0-0-0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </disk>
Nov 28 23:02:05 user nova-compute[74959]:     <controller type='usb' index='0' model='none'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='usb'/>
Nov 28 23:02:05 user nova-compute[74959]:     </controller>
Nov 28 23:02:05 user nova-compute[74959]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='pci.0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </controller>
Nov 28 23:02:05 user nova-compute[74959]:     <controller type='ide' index='0'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='ide'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 23:02:05 user nova-compute[74959]:     </controller>
Nov 28 23:02:05 user nova-compute[74959]:     <interface type='ethernet'>
Nov 28 23:02:05 user nova-compute[74959]:       <mac address='fa:16:3e:84:4e:67'/>
Nov 28 23:02:05 user nova-compute[74959]:       <target dev='tapc3f3885d-8b'/>
Nov 28 23:02:05 user nova-compute[74959]:       <model type='virtio'/>
Nov 28 23:02:05 user nova-compute[74959]:       <mtu size='1442'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='net0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </interface>
Nov 28 23:02:05 user nova-compute[74959]:     <serial type='pty'>
Nov 28 23:02:05 user nova-compute[74959]:       <source path='/dev/pts/8'/>
Nov 28 23:02:05 user nova-compute[74959]:       <log file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log' append='off'/>
Nov 28 23:02:05 user nova-compute[74959]:       <target type='isa-serial' port='0'>
Nov 28 23:02:05 user nova-compute[74959]:         <model name='isa-serial'/>
Nov 28 23:02:05 user nova-compute[74959]:       </target>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='serial0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </serial>
Nov 28 23:02:05 user nova-compute[74959]:     <console type='pty' tty='/dev/pts/8'>
Nov 28 23:02:05 user nova-compute[74959]:       <source path='/dev/pts/8'/>
Nov 28 23:02:05 user nova-compute[74959]:       <log file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log' append='off'/>
Nov 28 23:02:05 user nova-compute[74959]:       <target type='serial' port='0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='serial0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </console>
Nov 28 23:02:05 user nova-compute[74959]:     <input type='mouse' bus='ps2'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='input0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </input>
Nov 28 23:02:05 user nova-compute[74959]:     <input type='keyboard' bus='ps2'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='input1'/>
Nov 28 23:02:05 user nova-compute[74959]:     </input>
Nov 28 23:02:05 user nova-compute[74959]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 28 23:02:05 user nova-compute[74959]:       <listen type='address' address='0.0.0.0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </graphics>
Nov 28 23:02:05 user nova-compute[74959]:     <audio id='1' type='none'/>
Nov 28 23:02:05 user nova-compute[74959]:     <video>
Nov 28 23:02:05 user nova-compute[74959]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='video0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </video>
Nov 28 23:02:05 user nova-compute[74959]:     <memballoon model='virtio'>
Nov 28 23:02:05 user nova-compute[74959]:       <stats period='10'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='balloon0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </memballoon>
Nov 28 23:02:05 user nova-compute[74959]:     <rng model='virtio'>
Nov 28 23:02:05 user nova-compute[74959]:       <backend model='random'>/dev/urandom</backend>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='rng0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </rng>
Nov 28 23:02:05 user nova-compute[74959]:   </devices>
Nov 28 23:02:05 user nova-compute[74959]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 23:02:05 user nova-compute[74959]:     <label>libvirt-6c504232-f516-4764-8df1-7bff0a3bd413</label>
Nov 28 23:02:05 user nova-compute[74959]:     <imagelabel>libvirt-6c504232-f516-4764-8df1-7bff0a3bd413</imagelabel>
Nov 28 23:02:05 user nova-compute[74959]:   </seclabel>
Nov 28 23:02:05 user nova-compute[74959]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 23:02:05 user nova-compute[74959]:     <label>+64055:+108</label>
Nov 28 23:02:05 user nova-compute[74959]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 23:02:05 user nova-compute[74959]:   </seclabel>
Nov 28 23:02:05 user nova-compute[74959]: </domain>
Nov 28 23:02:05 user nova-compute[74959]:  {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface> {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:a6:16:6d"/><model type="virtio"/><mtu size="1442"/><target dev="tapf21d9813-77"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 28 23:02:05 user nova-compute[74959]:   <name>instance-00000009</name>
Nov 28 23:02:05 user nova-compute[74959]:   <uuid>6c504232-f516-4764-8df1-7bff0a3bd413</uuid>
Nov 28 23:02:05 user nova-compute[74959]:   <metadata>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:05 user nova-compute[74959]:   <nova:package version="0.0.0"/>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:name>tempest-device-tagging-server-536022995</nova:name>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:creationTime>2023-11-28 23:02:04</nova:creationTime>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:flavor name="m1.tiny">
Nov 28 23:02:05 user nova-compute[74959]:     <nova:memory>512</nova:memory>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:disk>1</nova:disk>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:swap>0</nova:swap>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:flavor>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:owner>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:user uuid="1ee17e5f07f04b31b55b3fa94c8cf8a5">tempest-TaggedAttachmentsTest-1971458541-project-member</nova:user>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:project uuid="01c3efd63364440eb53df04de34a01bc">tempest-TaggedAttachmentsTest-1971458541</nova:project>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:owner>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:ports>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:port uuid="c3f3885d-8bb2-465b-a52f-b9ee64375c47">
Nov 28 23:02:05 user nova-compute[74959]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:02:05 user nova-compute[74959]:     </nova:port>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:ports>
Nov 28 23:02:05 user nova-compute[74959]: </nova:instance>
Nov 28 23:02:05 user nova-compute[74959]:   </metadata>
Nov 28 23:02:05 user nova-compute[74959]:   <memory unit='KiB'>524288</memory>
Nov 28 23:02:05 user nova-compute[74959]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 23:02:05 user nova-compute[74959]:   <vcpu placement='static'>1</vcpu>
Nov 28 23:02:05 user nova-compute[74959]:   <resource>
Nov 28 23:02:05 user nova-compute[74959]:     <partition>/machine</partition>
Nov 28 23:02:05 user nova-compute[74959]:   </resource>
Nov 28 23:02:05 user nova-compute[74959]:   <sysinfo type='smbios'>
Nov 28 23:02:05 user nova-compute[74959]:     <system>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='version'>0.0.0</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='serial'>6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='uuid'>6c504232-f516-4764-8df1-7bff0a3bd413</entry>
Nov 28 23:02:05 user nova-compute[74959]:       <entry name='family'>Virtual Machine</entry>
Nov 28 23:02:05 user nova-compute[74959]:     </system>
Nov 28 23:02:05 user nova-compute[74959]:   </sysinfo>
Nov 28 23:02:05 user nova-compute[74959]:   <os>
Nov 28 23:02:05 user nova-compute[74959]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 23:02:05 user nova-compute[74959]:     <boot dev='hd'/>
Nov 28 23:02:05 user nova-compute[74959]:     <smbios mode='sysinfo'/>
Nov 28 23:02:05 user nova-compute[74959]:   </os>
Nov 28 23:02:05 user nova-compute[74959]:   <features>
Nov 28 23:02:05 user nova-compute[74959]:     <acpi/>
Nov 28 23:02:05 user nova-compute[74959]:     <apic/>
Nov 28 23:02:05 user nova-compute[74959]:     <vmcoreinfo state='on'/>
Nov 28 23:02:05 user nova-compute[74959]:   </features>
Nov 28 23:02:05 user nova-compute[74959]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 23:02:05 user nova-compute[74959]:     <model fallback='forbid'>Nehalem</model>
Nov 28 23:02:05 user nova-compute[74959]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 23:02:05 user nova-compute[74959]:     <feature policy='require' name='vme'/>
Nov 28 23:02:05 user nova-compute[74959]:     <feature policy='require' name='x2apic'/>
Nov 28 23:02:05 user nova-compute[74959]:     <feature policy='require' name='hypervisor'/>
Nov 28 23:02:05 user nova-compute[74959]:   </cpu>
Nov 28 23:02:05 user nova-compute[74959]:   <clock offset='utc'>
Nov 28 23:02:05 user nova-compute[74959]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 23:02:05 user nova-compute[74959]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 23:02:05 user nova-compute[74959]:     <timer name='hpet' present='no'/>
Nov 28 23:02:05 user nova-compute[74959]:   </clock>
Nov 28 23:02:05 user nova-compute[74959]:   <on_poweroff>destroy</on_poweroff>
Nov 28 23:02:05 user nova-compute[74959]:   <on_reboot>restart</on_reboot>
Nov 28 23:02:05 user nova-compute[74959]:   <on_crash>destroy</on_crash>
Nov 28 23:02:05 user nova-compute[74959]:   <devices>
Nov 28 23:02:05 user nova-compute[74959]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 23:02:05 user nova-compute[74959]:     <disk type='file' device='disk'>
Nov 28 23:02:05 user nova-compute[74959]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 23:02:05 user nova-compute[74959]:       <source file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk' index='2'/>
Nov 28 23:02:05 user nova-compute[74959]:       <backingStore type='file' index='3'>
Nov 28 23:02:05 user nova-compute[74959]:         <format type='raw'/>
Nov 28 23:02:05 user nova-compute[74959]:         <source file='/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8'/>
Nov 28 23:02:05 user nova-compute[74959]:         <backingStore/>
Nov 28 23:02:05 user nova-compute[74959]:       </backingStore>
Nov 28 23:02:05 user nova-compute[74959]:       <target dev='vda' bus='virtio'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='virtio-disk0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </disk>
Nov 28 23:02:05 user nova-compute[74959]:     <disk type='file' device='cdrom'>
Nov 28 23:02:05 user nova-compute[74959]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 23:02:05 user nova-compute[74959]:       <source file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/disk.config' index='1'/>
Nov 28 23:02:05 user nova-compute[74959]:       <backingStore/>
Nov 28 23:02:05 user nova-compute[74959]:       <target dev='hda' bus='ide'/>
Nov 28 23:02:05 user nova-compute[74959]:       <readonly/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='ide0-0-0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </disk>
Nov 28 23:02:05 user nova-compute[74959]:     <controller type='usb' index='0' model='none'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='usb'/>
Nov 28 23:02:05 user nova-compute[74959]:     </controller>
Nov 28 23:02:05 user nova-compute[74959]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='pci.0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </controller>
Nov 28 23:02:05 user nova-compute[74959]:     <controller type='ide' index='0'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='ide'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 23:02:05 user nova-compute[74959]:     </controller>
Nov 28 23:02:05 user nova-compute[74959]:     <interface type='ethernet'>
Nov 28 23:02:05 user nova-compute[74959]:       <mac address='fa:16:3e:84:4e:67'/>
Nov 28 23:02:05 user nova-compute[74959]:       <target dev='tapc3f3885d-8b'/>
Nov 28 23:02:05 user nova-compute[74959]:       <model type='virtio'/>
Nov 28 23:02:05 user nova-compute[74959]:       <mtu size='1442'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='net0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </interface>
Nov 28 23:02:05 user nova-compute[74959]:     <serial type='pty'>
Nov 28 23:02:05 user nova-compute[74959]:       <source path='/dev/pts/8'/>
Nov 28 23:02:05 user nova-compute[74959]:       <log file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log' append='off'/>
Nov 28 23:02:05 user nova-compute[74959]:       <target type='isa-serial' port='0'>
Nov 28 23:02:05 user nova-compute[74959]:         <model name='isa-serial'/>
Nov 28 23:02:05 user nova-compute[74959]:       </target>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='serial0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </serial>
Nov 28 23:02:05 user nova-compute[74959]:     <console type='pty' tty='/dev/pts/8'>
Nov 28 23:02:05 user nova-compute[74959]:       <source path='/dev/pts/8'/>
Nov 28 23:02:05 user nova-compute[74959]:       <log file='/opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413/console.log' append='off'/>
Nov 28 23:02:05 user nova-compute[74959]:       <target type='serial' port='0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='serial0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </console>
Nov 28 23:02:05 user nova-compute[74959]:     <input type='mouse' bus='ps2'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='input0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </input>
Nov 28 23:02:05 user nova-compute[74959]:     <input type='keyboard' bus='ps2'>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='input1'/>
Nov 28 23:02:05 user nova-compute[74959]:     </input>
Nov 28 23:02:05 user nova-compute[74959]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 28 23:02:05 user nova-compute[74959]:       <listen type='address' address='0.0.0.0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </graphics>
Nov 28 23:02:05 user nova-compute[74959]:     <audio id='1' type='none'/>
Nov 28 23:02:05 user nova-compute[74959]:     <video>
Nov 28 23:02:05 user nova-compute[74959]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='video0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </video>
Nov 28 23:02:05 user nova-compute[74959]:     <memballoon model='virtio'>
Nov 28 23:02:05 user nova-compute[74959]:       <stats period='10'/>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='balloon0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </memballoon>
Nov 28 23:02:05 user nova-compute[74959]:     <rng model='virtio'>
Nov 28 23:02:05 user nova-compute[74959]:       <backend model='random'>/dev/urandom</backend>
Nov 28 23:02:05 user nova-compute[74959]:       <alias name='rng0'/>
Nov 28 23:02:05 user nova-compute[74959]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 23:02:05 user nova-compute[74959]:     </rng>
Nov 28 23:02:05 user nova-compute[74959]:   </devices>
Nov 28 23:02:05 user nova-compute[74959]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 23:02:05 user nova-compute[74959]:     <label>libvirt-6c504232-f516-4764-8df1-7bff0a3bd413</label>
Nov 28 23:02:05 user nova-compute[74959]:     <imagelabel>libvirt-6c504232-f516-4764-8df1-7bff0a3bd413</imagelabel>
Nov 28 23:02:05 user nova-compute[74959]:   </seclabel>
Nov 28 23:02:05 user nova-compute[74959]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 23:02:05 user nova-compute[74959]:     <label>+64055:+108</label>
Nov 28 23:02:05 user nova-compute[74959]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 23:02:05 user nova-compute[74959]:   </seclabel>
Nov 28 23:02:05 user nova-compute[74959]: </domain>
Nov 28 23:02:05 user nova-compute[74959]:  {{(pid=74959) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 23:02:05 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Detaching interface fa:16:3e:a6:16:6d failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf21d9813-77' not found.
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Converting VIF {"id": "f21d9813-7728-4e0b-b624-604cc413dc12", "address": "fa:16:3e:a6:16:6d", "network": {"id": "fe15c999-20b2-4ad7-a1ac-7644c412d38d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1115180485", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf21d9813-77", "ovs_interfaceid": "f21d9813-7728-4e0b-b624-604cc413dc12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG os_vif [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf21d9813-77, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:02:05 user nova-compute[74959]: INFO os_vif [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:6d,bridge_name='br-int',has_traffic_filtering=True,id=f21d9813-7728-4e0b-b624-604cc413dc12,network=Network(fe15c999-20b2-4ad7-a1ac-7644c412d38d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf21d9813-77')
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [req-1a8f7de9-1455-4fa0-949d-7ca4568869db req-86d470cf-c5bd-4177-a8ec-a12e903c7422 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:05 user nova-compute[74959]:   <nova:package version="0.0.0"/>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:name>tempest-device-tagging-server-536022995</nova:name>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:creationTime>2023-11-28 23:02:05</nova:creationTime>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:flavor name="m1.tiny">
Nov 28 23:02:05 user nova-compute[74959]:     <nova:memory>512</nova:memory>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:disk>1</nova:disk>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:swap>0</nova:swap>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:flavor>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:owner>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:user uuid="1ee17e5f07f04b31b55b3fa94c8cf8a5">tempest-TaggedAttachmentsTest-1971458541-project-member</nova:user>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:project uuid="01c3efd63364440eb53df04de34a01bc">tempest-TaggedAttachmentsTest-1971458541</nova:project>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:owner>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:02:05 user nova-compute[74959]:   <nova:ports>
Nov 28 23:02:05 user nova-compute[74959]:     <nova:port uuid="c3f3885d-8bb2-465b-a52f-b9ee64375c47">
Nov 28 23:02:05 user nova-compute[74959]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:02:05 user nova-compute[74959]:     </nova:port>
Nov 28 23:02:05 user nova-compute[74959]:   </nova:ports>
Nov 28 23:02:05 user nova-compute[74959]: </nova:instance>
Nov 28 23:02:05 user nova-compute[74959]:  {{(pid=74959) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [{"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Releasing lock "refresh_cache-6c504232-f516-4764-8df1-7bff0a3bd413" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d1b2fbfa-0c83-4e57-86c2-2e76235a5428 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "interface-6c504232-f516-4764-8df1-7bff0a3bd413-f21d9813-7728-4e0b-b624-604cc413dc12" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.353s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:02:13 user nova-compute[74959]: INFO nova.compute.claims [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Claim successful on node user
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:02:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.policy [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b801c03a17a54b2dbb2d7d7e1a708126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ef9d9fe9334bb19ddccc256847afcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:02:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Creating image(s)
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "/opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "/opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "/opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk 1073741824" returned: 0 in 0.066s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Successfully created port: 23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Cannot resize image /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Ensure instance console log exists: /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Successfully updated port: 23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "refresh_cache-73fd8da6-d3c7-4401-a5cb-18365b030aa4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquired lock "refresh_cache-73fd8da6-d3c7-4401-a5cb-18365b030aa4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-b24a955a-0965-4d7c-b56e-33f1b30221a0 req-388170de-1df4-4d92-96a1-c04ba1d2186b service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received event network-changed-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-b24a955a-0965-4d7c-b56e-33f1b30221a0 req-388170de-1df4-4d92-96a1-c04ba1d2186b service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Refreshing instance network info cache due to event network-changed-23bd317b-6946-4ae5-91de-b685b8b8faf4. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b24a955a-0965-4d7c-b56e-33f1b30221a0 req-388170de-1df4-4d92-96a1-c04ba1d2186b service nova] Acquiring lock "refresh_cache-73fd8da6-d3c7-4401-a5cb-18365b030aa4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Updating instance_info_cache with network_info: [{"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Releasing lock "refresh_cache-73fd8da6-d3c7-4401-a5cb-18365b030aa4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Instance network_info: |[{"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b24a955a-0965-4d7c-b56e-33f1b30221a0 req-388170de-1df4-4d92-96a1-c04ba1d2186b service nova] Acquired lock "refresh_cache-73fd8da6-d3c7-4401-a5cb-18365b030aa4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.neutron [req-b24a955a-0965-4d7c-b56e-33f1b30221a0 req-388170de-1df4-4d92-96a1-c04ba1d2186b service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Refreshing network info cache for port 23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Start _get_guest_xml network_info=[{"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:02:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1231430551',display_name='tempest-VolumesAdminNegativeTest-server-1231430551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1231430551',id=14,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ef9d9fe9334bb19ddccc256847afcc',ramdisk_id='',reservation_id='r-3s1pf0ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1277404831',owner_user_name='tempest-VolumesAdminNegativeTest-1277404831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:14Z,user_data=None,user_id='b801c03a17a54b2dbb2d7d7e1a708126',uuid=73fd8da6-d3c7-4401-a5cb-18365b030aa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converting VIF {"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:61:87,bridge_name='br-int',has_traffic_filtering=True,id=23bd317b-6946-4ae5-91de-b685b8b8faf4,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bd317b-69') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.objects.instance [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lazy-loading 'pci_devices' on Instance uuid 73fd8da6-d3c7-4401-a5cb-18365b030aa4 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:02:15 user nova-compute[74959]:   <uuid>73fd8da6-d3c7-4401-a5cb-18365b030aa4</uuid>
Nov 28 23:02:15 user nova-compute[74959]:   <name>instance-0000000e</name>
Nov 28 23:02:15 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:02:15 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:02:15 user nova-compute[74959]:   <metadata>
Nov 28 23:02:15 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:15 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:02:15 user nova-compute[74959]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1231430551</nova:name>
Nov 28 23:02:15 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:02:15</nova:creationTime>
Nov 28 23:02:15 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:02:15 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:02:15 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:02:15 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:02:15 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:15 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:15 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:02:15 user nova-compute[74959]:       <nova:owner>
Nov 28 23:02:15 user nova-compute[74959]:         <nova:user uuid="b801c03a17a54b2dbb2d7d7e1a708126">tempest-VolumesAdminNegativeTest-1277404831-project-member</nova:user>
Nov 28 23:02:15 user nova-compute[74959]:         <nova:project uuid="29ef9d9fe9334bb19ddccc256847afcc">tempest-VolumesAdminNegativeTest-1277404831</nova:project>
Nov 28 23:02:15 user nova-compute[74959]:       </nova:owner>
Nov 28 23:02:15 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:02:15 user nova-compute[74959]:       <nova:ports>
Nov 28 23:02:15 user nova-compute[74959]:         <nova:port uuid="23bd317b-6946-4ae5-91de-b685b8b8faf4">
Nov 28 23:02:15 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 23:02:15 user nova-compute[74959]:         </nova:port>
Nov 28 23:02:15 user nova-compute[74959]:       </nova:ports>
Nov 28 23:02:15 user nova-compute[74959]:     </nova:instance>
Nov 28 23:02:15 user nova-compute[74959]:   </metadata>
Nov 28 23:02:15 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:02:15 user nova-compute[74959]:     <system>
Nov 28 23:02:15 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:02:15 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:02:15 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:02:15 user nova-compute[74959]:       <entry name="serial">73fd8da6-d3c7-4401-a5cb-18365b030aa4</entry>
Nov 28 23:02:15 user nova-compute[74959]:       <entry name="uuid">73fd8da6-d3c7-4401-a5cb-18365b030aa4</entry>
Nov 28 23:02:15 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:02:15 user nova-compute[74959]:     </system>
Nov 28 23:02:15 user nova-compute[74959]:   </sysinfo>
Nov 28 23:02:15 user nova-compute[74959]:   <os>
Nov 28 23:02:15 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:02:15 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:02:15 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:02:15 user nova-compute[74959]:   </os>
Nov 28 23:02:15 user nova-compute[74959]:   <features>
Nov 28 23:02:15 user nova-compute[74959]:     <acpi/>
Nov 28 23:02:15 user nova-compute[74959]:     <apic/>
Nov 28 23:02:15 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:02:15 user nova-compute[74959]:   </features>
Nov 28 23:02:15 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:02:15 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:02:15 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:02:15 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:02:15 user nova-compute[74959]:   </clock>
Nov 28 23:02:15 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:02:15 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:02:15 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:02:15 user nova-compute[74959]:   </cpu>
Nov 28 23:02:15 user nova-compute[74959]:   <devices>
Nov 28 23:02:15 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:02:15 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:02:15 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk"/>
Nov 28 23:02:15 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:02:15 user nova-compute[74959]:     </disk>
Nov 28 23:02:15 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:02:15 user nova-compute[74959]:       <mac address="fa:16:3e:1a:61:87"/>
Nov 28 23:02:15 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:02:15 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:02:15 user nova-compute[74959]:       <target dev="tap23bd317b-69"/>
Nov 28 23:02:15 user nova-compute[74959]:     </interface>
Nov 28 23:02:15 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:02:15 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/console.log" append="off"/>
Nov 28 23:02:15 user nova-compute[74959]:     </serial>
Nov 28 23:02:15 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:02:15 user nova-compute[74959]:     <video>
Nov 28 23:02:15 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:02:15 user nova-compute[74959]:     </video>
Nov 28 23:02:15 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:02:15 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:02:15 user nova-compute[74959]:     </rng>
Nov 28 23:02:15 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:02:15 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:02:15 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:02:15 user nova-compute[74959]:     </memballoon>
Nov 28 23:02:15 user nova-compute[74959]:   </devices>
Nov 28 23:02:15 user nova-compute[74959]: </domain>
Nov 28 23:02:15 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1231430551',display_name='tempest-VolumesAdminNegativeTest-server-1231430551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1231430551',id=14,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ef9d9fe9334bb19ddccc256847afcc',ramdisk_id='',reservation_id='r-3s1pf0ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1277404831',owner_user_name='tempest-VolumesAdminNegativeTest-1277404831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:14Z,user_data=None,user_id='b801c03a17a54b2dbb2d7d7e1a708126',uuid=73fd8da6-d3c7-4401-a5cb-18365b030aa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converting VIF {"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:61:87,bridge_name='br-int',has_traffic_filtering=True,id=23bd317b-6946-4ae5-91de-b685b8b8faf4,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bd317b-69') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG os_vif [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:61:87,bridge_name='br-int',has_traffic_filtering=True,id=23bd317b-6946-4ae5-91de-b685b8b8faf4,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bd317b-69') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3aa6f05f-cad9-56d1-a12e-f952ebd18463', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23bd317b-69, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23bd317b-69, col_values=(('qos', UUID('0ffde9fd-337e-4923-ad76-a45df190e9b9')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23bd317b-69, col_values=(('external_ids', {'iface-id': '23bd317b-6946-4ae5-91de-b685b8b8faf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:61:87', 'vm-uuid': '73fd8da6-d3c7-4401-a5cb-18365b030aa4'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:15 user nova-compute[74959]: INFO os_vif [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:61:87,bridge_name='br-int',has_traffic_filtering=True,id=23bd317b-6946-4ae5-91de-b685b8b8faf4,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bd317b-69')
Nov 28 23:02:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:02:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] No VIF found with MAC fa:16:3e:1a:61:87, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:02:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-b24a955a-0965-4d7c-b56e-33f1b30221a0 req-388170de-1df4-4d92-96a1-c04ba1d2186b service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Updated VIF entry in instance network info cache for port 23bd317b-6946-4ae5-91de-b685b8b8faf4. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:02:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-b24a955a-0965-4d7c-b56e-33f1b30221a0 req-388170de-1df4-4d92-96a1-c04ba1d2186b service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Updating instance_info_cache with network_info: [{"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b24a955a-0965-4d7c-b56e-33f1b30221a0 req-388170de-1df4-4d92-96a1-c04ba1d2186b service nova] Releasing lock "refresh_cache-73fd8da6-d3c7-4401-a5cb-18365b030aa4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-118ffbfb-7b34-4c4d-b539-58f0c8cf71b5 req-5b6036f7-3b04-4db6-ab9c-3a02c09e71a3 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received event network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-118ffbfb-7b34-4c4d-b539-58f0c8cf71b5 req-5b6036f7-3b04-4db6-ab9c-3a02c09e71a3 service nova] Acquiring lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-118ffbfb-7b34-4c4d-b539-58f0c8cf71b5 req-5b6036f7-3b04-4db6-ab9c-3a02c09e71a3 service nova] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-118ffbfb-7b34-4c4d-b539-58f0c8cf71b5 req-5b6036f7-3b04-4db6-ab9c-3a02c09e71a3 service nova] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-118ffbfb-7b34-4c4d-b539-58f0c8cf71b5 req-5b6036f7-3b04-4db6-ab9c-3a02c09e71a3 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] No waiting events found dispatching network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:17 user nova-compute[74959]: WARNING nova.compute.manager [req-118ffbfb-7b34-4c4d-b539-58f0c8cf71b5 req-5b6036f7-3b04-4db6-ab9c-3a02c09e71a3 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received unexpected event network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 for instance with vm_state building and task_state spawning.
Nov 28 23:02:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:02:19 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Instance spawned successfully.
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-68b25f2a-a615-484d-9639-8a5f645843f8 req-079ee7cf-a9a5-4ed0-bb16-425b6cc597c4 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received event network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-68b25f2a-a615-484d-9639-8a5f645843f8 req-079ee7cf-a9a5-4ed0-bb16-425b6cc597c4 service nova] Acquiring lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-68b25f2a-a615-484d-9639-8a5f645843f8 req-079ee7cf-a9a5-4ed0-bb16-425b6cc597c4 service nova] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-68b25f2a-a615-484d-9639-8a5f645843f8 req-079ee7cf-a9a5-4ed0-bb16-425b6cc597c4 service nova] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-68b25f2a-a615-484d-9639-8a5f645843f8 req-079ee7cf-a9a5-4ed0-bb16-425b6cc597c4 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] No waiting events found dispatching network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:19 user nova-compute[74959]: WARNING nova.compute.manager [req-68b25f2a-a615-484d-9639-8a5f645843f8 req-079ee7cf-a9a5-4ed0-bb16-425b6cc597c4 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received unexpected event network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 for instance with vm_state building and task_state spawning.
Nov 28 23:02:19 user nova-compute[74959]: INFO nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 28 23:02:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:02:20 user nova-compute[74959]: INFO nova.compute.manager [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Took 6.89 seconds to build instance.
Nov 28 23:02:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-256fc5aa-64b5-40f5-8ddd-62c99d0b1f2a tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.018s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:23 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 is timed out.
Nov 28 23:02:23 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Successfully detached device vdb from instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 from the live domain config.
Nov 28 23:02:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opNVMKWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '24ca1a51-2325-440a-bb07-c369e72aa523'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:23 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[10600c66-1a02-413c-89c3-0f0f0c8eb42f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:02:23 user nova-compute[74959]: No targets found.
Nov 28 23:02:23 user nova-compute[74959]: iSNS:
Nov 28 23:02:23 user nova-compute[74959]: No targets found.
Nov 28 23:02:23 user nova-compute[74959]: STATIC:
Nov 28 23:02:23 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:02:23 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:23 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:23 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523
Nov 28 23:02:23 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:23 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:23 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:02:23 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:23 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:23 user nova-compute[74959]: FIRMWARE:
Nov 28 23:02:23 user nova-compute[74959]: No targets found.
Nov 28 23:02:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:02:23 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:02:23 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[296ec5ef-d3e4-4609-87d9-e054e735ac71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa259d0-5f83-4703-8ce4-2ae226427666]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:02:23 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:23 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 (non-flash)
Nov 28 23:02:23 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:23 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec36f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4d4fe6-e3e7-44d6-a10e-5de9c3a9b3ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5863258-569b-4e72-983f-572026d5e978]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3d0883-fcbd-459b-9457-cb17939efc0c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[72412b09-1367-45d3-b7df-5364ae77a8b7]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4580d3-cc6e-42c0-81bf-7fb080b8a81b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c0eb8-c7f6-4190-b28f-b4382cab3dd3]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260]
Nov 28 23:02:23 user nova-compute[74959]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523, portal: 172.16.0.220,3260] successful.
Nov 28 23:02:23 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ca1a51-2325-440a-bb07-c369e72aa523 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0bc625-96f9-44a5-8b70-7fe414e45e6a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] <== disconnect_volume: return (308ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:23 user nova-compute[74959]: INFO nova.compute.manager [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Terminating instance
Nov 28 23:02:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-e8efe4bc-8da5-4556-a98f-19e610fb1e8e req-159aa1b2-05be-44b3-bf54-5d4f89166b57 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received event network-vif-unplugged-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e8efe4bc-8da5-4556-a98f-19e610fb1e8e req-159aa1b2-05be-44b3-bf54-5d4f89166b57 service nova] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e8efe4bc-8da5-4556-a98f-19e610fb1e8e req-159aa1b2-05be-44b3-bf54-5d4f89166b57 service nova] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e8efe4bc-8da5-4556-a98f-19e610fb1e8e req-159aa1b2-05be-44b3-bf54-5d4f89166b57 service nova] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-e8efe4bc-8da5-4556-a98f-19e610fb1e8e req-159aa1b2-05be-44b3-bf54-5d4f89166b57 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] No waiting events found dispatching network-vif-unplugged-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-e8efe4bc-8da5-4556-a98f-19e610fb1e8e req-159aa1b2-05be-44b3-bf54-5d4f89166b57 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received event network-vif-unplugged-e9513da7-b67d-4b0f-b277-5c533a317db1 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lazy-loading 'flavor' on Instance uuid ab7dbb0e-6b7e-4250-b0b9-23307c335494 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8a6ac9e-471b-479c-8631-491d5679913e tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.826s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Instance destroyed successfully.
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.objects.instance [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lazy-loading 'resources' on Instance uuid d0d20108-9362-4586-9d9d-88522ce58ad7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1109565946',display_name='tempest-VolumesAssistedSnapshotsTest-server-1109565946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1109565946',id=11,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsqVnLCMe34EDJQQrghlZbZXBycl8oazZSwLbt6y6h5ytmL5UK0t+kCc0AglJ+zA5PfjIuyfYuO4YWAb0DKRifxRTsmlF6lVTYJ6fmKLzkV+ncEwXVdrY8q9zE1Elu2qQ==',key_name='tempest-keypair-106570242',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='503d169a75fb4c7b9e7840d525536f93',ramdisk_id='',reservation_id='r-rzywrjp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1401385343',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1401385343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ffbeb9c8d5d4e1ca4d2221ec6bdab9c',uuid=d0d20108-9362-4586-9d9d-88522ce58ad7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Converting VIF {"id": "e9513da7-b67d-4b0f-b277-5c533a317db1", "address": "fa:16:3e:04:00:f9", "network": {"id": "bf708527-3c3d-4dbe-aae7-01e87def40ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2105571553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "503d169a75fb4c7b9e7840d525536f93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9513da7-b6", "ovs_interfaceid": "e9513da7-b67d-4b0f-b277-5c533a317db1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:00:f9,bridge_name='br-int',has_traffic_filtering=True,id=e9513da7-b67d-4b0f-b277-5c533a317db1,network=Network(bf708527-3c3d-4dbe-aae7-01e87def40ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9513da7-b6') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG os_vif [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:00:f9,bridge_name='br-int',has_traffic_filtering=True,id=e9513da7-b67d-4b0f-b277-5c533a317db1,network=Network(bf708527-3c3d-4dbe-aae7-01e87def40ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9513da7-b6') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9513da7-b6, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54b2f1fb-3fd7-4aa1-8837-e58377477246) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:24 user nova-compute[74959]: INFO os_vif [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:00:f9,bridge_name='br-int',has_traffic_filtering=True,id=e9513da7-b67d-4b0f-b277-5c533a317db1,network=Network(bf708527-3c3d-4dbe-aae7-01e87def40ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9513da7-b6')
Nov 28 23:02:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Deleting instance files /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7_del
Nov 28 23:02:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Deletion of /opt/stack/data/nova/instances/d0d20108-9362-4586-9d9d-88522ce58ad7_del complete
Nov 28 23:02:24 user nova-compute[74959]: INFO nova.compute.manager [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 28 23:02:24 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:02:24 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:02:25 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:25 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Took 0.87 seconds to deallocate network for instance.
Nov 28 23:02:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-d61bf62a-d8c5-4d0d-9e75-1a5818b0392b req-a9dc1a72-45cf-4d7a-8ef6-9478dfbbfbae service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received event network-vif-deleted-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:25 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:02:25 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:02:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:26 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Deleted allocations for instance d0d20108-9362-4586-9d9d-88522ce58ad7
Nov 28 23:02:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-7968a9c9-efbe-4480-b51a-d53da7307e3c req-0ceaa26d-5dcb-41fa-adfa-6bba3b0fcee4 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received event network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7968a9c9-efbe-4480-b51a-d53da7307e3c req-0ceaa26d-5dcb-41fa-adfa-6bba3b0fcee4 service nova] Acquiring lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7968a9c9-efbe-4480-b51a-d53da7307e3c req-0ceaa26d-5dcb-41fa-adfa-6bba3b0fcee4 service nova] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7968a9c9-efbe-4480-b51a-d53da7307e3c req-0ceaa26d-5dcb-41fa-adfa-6bba3b0fcee4 service nova] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-7968a9c9-efbe-4480-b51a-d53da7307e3c req-0ceaa26d-5dcb-41fa-adfa-6bba3b0fcee4 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] No waiting events found dispatching network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:26 user nova-compute[74959]: WARNING nova.compute.manager [req-7968a9c9-efbe-4480-b51a-d53da7307e3c req-0ceaa26d-5dcb-41fa-adfa-6bba3b0fcee4 service nova] [instance: d0d20108-9362-4586-9d9d-88522ce58ad7] Received unexpected event network-vif-plugged-e9513da7-b67d-4b0f-b277-5c533a317db1 for instance with vm_state deleted and task_state None.
Nov 28 23:02:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5061d3d1-8397-4b47-9279-44580ae83e1d tempest-VolumesAssistedSnapshotsTest-1401385343 tempest-VolumesAssistedSnapshotsTest-1401385343-project-member] Lock "d0d20108-9362-4586-9d9d-88522ce58ad7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "e245a015-fc98-4557-8168-5089c3746e79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:02:31 user nova-compute[74959]: INFO nova.compute.claims [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Claim successful on node user
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:02:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:02:31 user nova-compute[74959]: INFO nova.virt.block_device [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Booting with blank volume at /dev/vda
Nov 28 23:02:31 user nova-compute[74959]: DEBUG nova.policy [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8d218abbe14f27b754f1fffd9553f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da22f0050e34c9b9a7658f16c08f28b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:02:32 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Successfully created port: 7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Successfully updated port: 7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquired lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-7447dd27-f97a-4c55-9e66-2ded30401cfa req-9d431b88-ed32-4574-a2e6-b7d9f319ce54 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-changed-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-7447dd27-f97a-4c55-9e66-2ded30401cfa req-9d431b88-ed32-4574-a2e6-b7d9f319ce54 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Refreshing instance network info cache due to event network-changed-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7447dd27-f97a-4c55-9e66-2ded30401cfa req-9d431b88-ed32-4574-a2e6-b7d9f319ce54 service nova] Acquiring lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:33 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG nova.network.neutron [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating instance_info_cache with network_info: [{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Releasing lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance network_info: |[{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7447dd27-f97a-4c55-9e66-2ded30401cfa req-9d431b88-ed32-4574-a2e6-b7d9f319ce54 service nova] Acquired lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG nova.network.neutron [req-7447dd27-f97a-4c55-9e66-2ded30401cfa req-9d431b88-ed32-4574-a2e6-b7d9f319ce54 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Refreshing network info cache for port 7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG nova.network.neutron [req-7447dd27-f97a-4c55-9e66-2ded30401cfa req-9d431b88-ed32-4574-a2e6-b7d9f319ce54 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updated VIF entry in instance network info cache for port 7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG nova.network.neutron [req-7447dd27-f97a-4c55-9e66-2ded30401cfa req-9d431b88-ed32-4574-a2e6-b7d9f319ce54 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating instance_info_cache with network_info: [{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7447dd27-f97a-4c55-9e66-2ded30401cfa req-9d431b88-ed32-4574-a2e6-b7d9f319ce54 service nova] Releasing lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG nova.objects.instance [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lazy-loading 'flavor' on Instance uuid 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:35 user nova-compute[74959]: INFO nova.compute.manager [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Terminating instance
Nov 28 23:02:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:35 user nova-compute[74959]: INFO nova.compute.manager [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Attaching volume b5e6b154-a7cf-41bf-b0c8-a559df5579b2 to /dev/vdb
Nov 28 23:02:35 user nova-compute[74959]: DEBUG os_brick.utils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a9f47f-50e4-4cfc-893e-5f0ec12aac9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f970e6a1-fec1-48e0-baf2-b482bc88ee60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda487bd-9eb9-42e5-9cb2-e0e801260428]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[739b2819-f745-4be7-96ef-bfd0164b0d95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:02:35 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77c1460-40d6-4102-873a-9370903dec02]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG os_brick.utils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating existing volume attachment record: 21a54647-a32a-4f74-b21a-4d539ef59abe {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-490db4d4-cd29-43e5-9a51-8e74c7188066 req-56a19623-d670-4ef7-b188-b0076985f879 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-unplugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-490db4d4-cd29-43e5-9a51-8e74c7188066 req-56a19623-d670-4ef7-b188-b0076985f879 service nova] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-490db4d4-cd29-43e5-9a51-8e74c7188066 req-56a19623-d670-4ef7-b188-b0076985f879 service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-490db4d4-cd29-43e5-9a51-8e74c7188066 req-56a19623-d670-4ef7-b188-b0076985f879 service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-490db4d4-cd29-43e5-9a51-8e74c7188066 req-56a19623-d670-4ef7-b188-b0076985f879 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] No waiting events found dispatching network-vif-unplugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-490db4d4-cd29-43e5-9a51-8e74c7188066 req-56a19623-d670-4ef7-b188-b0076985f879 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-unplugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:02:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Instance destroyed successfully.
Nov 28 23:02:36 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lazy-loading 'resources' on Instance uuid 6c504232-f516-4764-8df1-7bff0a3bd413 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536022995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536022995',id=9,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY9iSmaUSC4acIfeowhAIFe0Mobnj9NokLjgmvR5928Fpj4Su6HLZ+SDAeETSAqLZ5Hs4l1e3b4v1z5ikTUW1uQkgkuQdA0aiZjT5cbOmIs0uMy25EBhypzgDLjftiaYg==',key_name='tempest-keypair-1991213725',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01c3efd63364440eb53df04de34a01bc',ramdisk_id='',reservation_id='r-svd3d3x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1971458541',owner_user_name='tempest-TaggedAttachmentsTest-1971458541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ee17e5f07f04b31b55b3fa94c8cf8a5',uuid=6c504232-f516-4764-8df1-7bff0a3bd413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converting VIF {"id": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "address": "fa:16:3e:84:4e:67", "network": {"id": "77b93d0e-626f-4d47-aa84-d522c489abe2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-423193147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c3efd63364440eb53df04de34a01bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f3885d-8b", "ovs_interfaceid": "c3f3885d-8bb2-465b-a52f-b9ee64375c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=c3f3885d-8bb2-465b-a52f-b9ee64375c47,network=Network(77b93d0e-626f-4d47-aa84-d522c489abe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f3885d-8b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG os_vif [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=c3f3885d-8bb2-465b-a52f-b9ee64375c47,network=Network(77b93d0e-626f-4d47-aa84-d522c489abe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f3885d-8b') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3f3885d-8b, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9364e006-93ba-4406-bee2-996ab5a82abc) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:36 user nova-compute[74959]: INFO os_vif [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=c3f3885d-8bb2-465b-a52f-b9ee64375c47,network=Network(77b93d0e-626f-4d47-aa84-d522c489abe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f3885d-8b')
Nov 28 23:02:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Deleting instance files /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413_del
Nov 28 23:02:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Deletion of /opt/stack/data/nova/instances/6c504232-f516-4764-8df1-7bff0a3bd413_del complete
Nov 28 23:02:36 user nova-compute[74959]: INFO nova.compute.manager [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 28 23:02:36 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:37 user nova-compute[74959]: INFO nova.compute.manager [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Unshelving
Nov 28 23:02:37 user nova-compute[74959]: INFO nova.virt.block_device [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Booting with volume 18f67820-210f-46b7-8bf3-4b786b77b966 at /dev/vdc
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.utils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6458e8ce-8a0e-443c-a293-82f8d0959ca2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe4629-3aa9-42f8-8ae4-7f2a4506bdf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[59044746-1b15-42d9-99cb-046ea8763fbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fc8381-a259-4eda-b43e-0f6c1e381925]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.utils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:02:37 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e9b04f-46a1-4b78-9b31-7f3e5076afc5]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.utils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating existing volume attachment record: d97f1f7e-2376-444c-970f-a4a27eacfd9d {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df17a81-08c3-4db3-99e2-98cc2675af1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a094be-a685-473f-a916-a0cbc80afa6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b9c86-1a1e-4dbe-a072-be85b3c9558c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8330b1-bba8-4162-8d90-4d7263eaa232]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-a285856b-2e8b-4977-8560-e446eeed1cf6 req-e800119d-1016-432a-9850-01d7a960549c service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a285856b-2e8b-4977-8560-e446eeed1cf6 req-e800119d-1016-432a-9850-01d7a960549c service nova] Acquiring lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a285856b-2e8b-4977-8560-e446eeed1cf6 req-e800119d-1016-432a-9850-01d7a960549c service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a285856b-2e8b-4977-8560-e446eeed1cf6 req-e800119d-1016-432a-9850-01d7a960549c service nova] Lock "6c504232-f516-4764-8df1-7bff0a3bd413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-a285856b-2e8b-4977-8560-e446eeed1cf6 req-e800119d-1016-432a-9850-01d7a960549c service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] No waiting events found dispatching network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:37 user nova-compute[74959]: WARNING nova.compute.manager [req-a285856b-2e8b-4977-8560-e446eeed1cf6 req-e800119d-1016-432a-9850-01d7a960549c service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received unexpected event network-vif-plugged-c3f3885d-8bb2-465b-a52f-b9ee64375c47 for instance with vm_state active and task_state deleting.
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:02:37 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcf6db9-2f11-4daf-bf15-d33497642298]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG os_brick.utils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating existing volume attachment record: 56b21725-5287-4410-8387-62ba6d7f715c {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:37 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Took 1.48 seconds to deallocate network for instance.
Nov 28 23:02:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-b90798ed-72e4-499b-91be-b70c623f593d req-8c617da5-4439-4dc0-b16b-f86826cc9833 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Received event network-vif-deleted-c3f3885d-8bb2-465b-a52f-b9ee64375c47 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:37 user nova-compute[74959]: INFO nova.compute.manager [req-b90798ed-72e4-499b-91be-b70c623f593d req-8c617da5-4439-4dc0-b16b-f86826cc9833 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Neutron deleted interface c3f3885d-8bb2-465b-a52f-b9ee64375c47; detaching it from the instance and deleting it from the info cache
Nov 28 23:02:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-b90798ed-72e4-499b-91be-b70c623f593d req-8c617da5-4439-4dc0-b16b-f86826cc9833 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-b90798ed-72e4-499b-91be-b70c623f593d req-8c617da5-4439-4dc0-b16b-f86826cc9833 service nova] [instance: 6c504232-f516-4764-8df1-7bff0a3bd413] Detach interface failed, port_id=c3f3885d-8bb2-465b-a52f-b9ee64375c47, reason: Instance 6c504232-f516-4764-8df1-7bff0a3bd413 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:38 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Deleted allocations for instance 6c504232-f516-4764-8df1-7bff0a3bd413
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3855e47e-34ef-42c5-bee2-d267a8a9b857 tempest-TaggedAttachmentsTest-1971458541 tempest-TaggedAttachmentsTest-1971458541-project-member] Lock "6c504232-f516-4764-8df1-7bff0a3bd413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.517s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:02:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:41 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:41 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7956MB free_disk=25.450611114501953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:02:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d339c51b-2c03-4ac9-800f-b5dc053e0585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance ab7dbb0e-6b7e-4250-b0b9-23307c335494 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6f965725-6fae-4b8a-abe2-801d29c8a21e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 73fd8da6-d3c7-4401-a5cb-18365b030aa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 94b085b2-b298-4780-be94-21f85c799945 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:02:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:43 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:43 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:43 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60170db-cf73-4863-8f21-1edf470aceba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:02:43 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[02725c8a-379b-4a9d-91d5-90fa1e7a4c70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2] added
Nov 28 23:02:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a330e9ba-a72f-41c0-b4a7-6f329fb6807b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd2ea6-c485-4446-a889-068a61550dd0]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGrXlNba {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGrXlNba" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c4b5c-5b23-4a44-a02b-cc7ca8e5a150]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGrXlNba'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d89966f-c875-4b91-bdb7-af2272d4f314]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b8f79e-2527-4a2c-a90c-aba9d1b216dd]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:44 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:44 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7820c96a-a759-475e-85d8-89451368bca2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]
Nov 28 23:02:44 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.
Nov 28 23:02:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f0441c-26f7-4bf1-aba2-27a132d59525]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da1277d-9416-40ee-9940-717160889dac]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:02:44 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:44 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:02:44 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:44 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c957d8a5-6dbb-43f9-8876-87c0f78984de]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:44 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26438343433343563', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438343433343563', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG nova.objects.instance [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lazy-loading 'flavor' on Instance uuid 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:02:45 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:02:45 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:02:45 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:02:45 user nova-compute[74959]:   <serial>b5e6b154-a7cf-41bf-b0c8-a559df5579b2</serial>
Nov 28 23:02:45 user nova-compute[74959]: </disk>
Nov 28 23:02:45 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] No VIF found with MAC fa:16:3e:b4:83:ed, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:02:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-231394a4-712a-47a5-b2b7-f5dbfe668cb7 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.509s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:02:46 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Creating image(s)
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Ensure instance console log exists: /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Start _get_guest_xml network_info=[{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agoWCfzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e245a015-fc98-4557-8168-5089c3746e79', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'serial': 'c4d040aa-729e-4f9c-bfe6-2ac14c0fa106'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '56b21725-5287-4410-8387-62ba6d7f715c', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:02:46 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:46 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agoWCfzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:46 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:46 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:46 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[11daf03a-4c9f-4d02-bd32-d3b21e691857]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:02:46 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5f2c83-895d-4cbb-85b3-61c1fbacb93a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106] added
Nov 28 23:02:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca6dab2-51bb-4c08-99fc-fef5a432891b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27cc1e-0624-4507-b25c-323c7a56f77d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agoWCfzU {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agoWCfzU" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[009faf5e-e7b1-455b-8385-180f010284c1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'agoWCfzU'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f94643f-005e-4fdc-99e6-618bab0559f2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bcdbfa-c73f-4edc-a51d-e16f13f14f80]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a7f3be-be3f-4d2f-9017-4b2865f727ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106, portal: 172.16.0.220,3260]
Nov 28 23:02:46 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106, portal: 172.16.0.220,3260] successful.
Nov 28 23:02:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5babb469-1775-4dd8-8177-3a0862154a40]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc96fb-ae47-4f99-97ea-06e39b1d6e56]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:46 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99dea96-2a37-4d0e-be8f-d91633703dd2]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:02:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agoWCfzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23134393532346432', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134393532346432', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1486772722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1486772722',id=15,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-vnxjucqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:32Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=e245a015-fc98-4557-8168-5089c3746e79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:99:34,bridge_name='br-int',has_traffic_filtering=True,id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7515dc9f-ea') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'pci_devices' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:02:47 user nova-compute[74959]:   <uuid>e245a015-fc98-4557-8168-5089c3746e79</uuid>
Nov 28 23:02:47 user nova-compute[74959]:   <name>instance-0000000f</name>
Nov 28 23:02:47 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:02:47 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:02:47 user nova-compute[74959]:   <metadata>
Nov 28 23:02:47 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:47 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:02:47 user nova-compute[74959]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1486772722</nova:name>
Nov 28 23:02:47 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:02:46</nova:creationTime>
Nov 28 23:02:47 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:02:47 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:02:47 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:02:47 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:02:47 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:47 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:47 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:02:47 user nova-compute[74959]:       <nova:owner>
Nov 28 23:02:47 user nova-compute[74959]:         <nova:user uuid="5a8d218abbe14f27b754f1fffd9553f8">tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member</nova:user>
Nov 28 23:02:47 user nova-compute[74959]:         <nova:project uuid="8da22f0050e34c9b9a7658f16c08f28b">tempest-ServerBootFromVolumeStableRescueTest-1156029205</nova:project>
Nov 28 23:02:47 user nova-compute[74959]:       </nova:owner>
Nov 28 23:02:47 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:02:47 user nova-compute[74959]:       <nova:ports>
Nov 28 23:02:47 user nova-compute[74959]:         <nova:port uuid="7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0">
Nov 28 23:02:47 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:02:47 user nova-compute[74959]:         </nova:port>
Nov 28 23:02:47 user nova-compute[74959]:       </nova:ports>
Nov 28 23:02:47 user nova-compute[74959]:     </nova:instance>
Nov 28 23:02:47 user nova-compute[74959]:   </metadata>
Nov 28 23:02:47 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:02:47 user nova-compute[74959]:     <system>
Nov 28 23:02:47 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:02:47 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:02:47 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:02:47 user nova-compute[74959]:       <entry name="serial">e245a015-fc98-4557-8168-5089c3746e79</entry>
Nov 28 23:02:47 user nova-compute[74959]:       <entry name="uuid">e245a015-fc98-4557-8168-5089c3746e79</entry>
Nov 28 23:02:47 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:02:47 user nova-compute[74959]:     </system>
Nov 28 23:02:47 user nova-compute[74959]:   </sysinfo>
Nov 28 23:02:47 user nova-compute[74959]:   <os>
Nov 28 23:02:47 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:02:47 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:02:47 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:02:47 user nova-compute[74959]:   </os>
Nov 28 23:02:47 user nova-compute[74959]:   <features>
Nov 28 23:02:47 user nova-compute[74959]:     <acpi/>
Nov 28 23:02:47 user nova-compute[74959]:     <apic/>
Nov 28 23:02:47 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:02:47 user nova-compute[74959]:   </features>
Nov 28 23:02:47 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:02:47 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:02:47 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:02:47 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:02:47 user nova-compute[74959]:   </clock>
Nov 28 23:02:47 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:02:47 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:02:47 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:02:47 user nova-compute[74959]:   </cpu>
Nov 28 23:02:47 user nova-compute[74959]:   <devices>
Nov 28 23:02:47 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:02:47 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:02:47 user nova-compute[74959]:       <source dev="/dev/sdc"/>
Nov 28 23:02:47 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:02:47 user nova-compute[74959]:       <serial>c4d040aa-729e-4f9c-bfe6-2ac14c0fa106</serial>
Nov 28 23:02:47 user nova-compute[74959]:     </disk>
Nov 28 23:02:47 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:02:47 user nova-compute[74959]:       <mac address="fa:16:3e:65:99:34"/>
Nov 28 23:02:47 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:02:47 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:02:47 user nova-compute[74959]:       <target dev="tap7515dc9f-ea"/>
Nov 28 23:02:47 user nova-compute[74959]:     </interface>
Nov 28 23:02:47 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:02:47 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/console.log" append="off"/>
Nov 28 23:02:47 user nova-compute[74959]:     </serial>
Nov 28 23:02:47 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:02:47 user nova-compute[74959]:     <video>
Nov 28 23:02:47 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:02:47 user nova-compute[74959]:     </video>
Nov 28 23:02:47 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:02:47 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:02:47 user nova-compute[74959]:     </rng>
Nov 28 23:02:47 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:02:47 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:02:47 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:02:47 user nova-compute[74959]:     </memballoon>
Nov 28 23:02:47 user nova-compute[74959]:   </devices>
Nov 28 23:02:47 user nova-compute[74959]: </domain>
Nov 28 23:02:47 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1486772722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1486772722',id=15,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-vnxjucqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:32Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=e245a015-fc98-4557-8168-5089c3746e79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:99:34,bridge_name='br-int',has_traffic_filtering=True,id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7515dc9f-ea') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG os_vif [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:99:34,bridge_name='br-int',has_traffic_filtering=True,id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7515dc9f-ea') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7996d5f1-b4d0-54a0-858e-d30fc3e0f20d', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7515dc9f-ea, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7515dc9f-ea, col_values=(('qos', UUID('41dca0d8-9218-400b-9894-e3f07f3a37bf')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7515dc9f-ea, col_values=(('external_ids', {'iface-id': '7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:99:34', 'vm-uuid': 'e245a015-fc98-4557-8168-5089c3746e79'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:47 user nova-compute[74959]: INFO os_vif [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:99:34,bridge_name='br-int',has_traffic_filtering=True,id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7515dc9f-ea')
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:02:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No VIF found with MAC fa:16:3e:65:99:34, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Stashing vm_state: active {{(pid=74959) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:02:48 user nova-compute[74959]: INFO nova.compute.claims [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Claim successful on node user
Nov 28 23:02:48 user nova-compute[74959]: INFO nova.compute.resource_tracker [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating resource usage from migration b318f89d-2e43-487c-9893-9dd914b299ab
Nov 28 23:02:48 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.482s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:48 user nova-compute[74959]: INFO nova.compute.manager [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Migrating
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:48 user nova-compute[74959]: INFO nova.compute.rpcapi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquired lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:48 user nova-compute[74959]: DEBUG nova.objects.instance [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'pci_requests' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG nova.objects.instance [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'numa_topology' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:02:49 user nova-compute[74959]: INFO nova.compute.claims [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Claim successful on node user
Nov 28 23:02:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:49 user nova-compute[74959]: INFO nova.network.neutron [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating port c60abc7f-b5c7-45ef-a218-d7454c7dbff8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Releasing lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-21a022c0-3d13-4eb7-80d4-a848fcc11a62 req-e18fb495-19d4-449f-8149-ef437f676a88 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21a022c0-3d13-4eb7-80d4-a848fcc11a62 req-e18fb495-19d4-449f-8149-ef437f676a88 service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21a022c0-3d13-4eb7-80d4-a848fcc11a62 req-e18fb495-19d4-449f-8149-ef437f676a88 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21a022c0-3d13-4eb7-80d4-a848fcc11a62 req-e18fb495-19d4-449f-8149-ef437f676a88 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-21a022c0-3d13-4eb7-80d4-a848fcc11a62 req-e18fb495-19d4-449f-8149-ef437f676a88 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:49 user nova-compute[74959]: WARNING nova.compute.manager [req-21a022c0-3d13-4eb7-80d4-a848fcc11a62 req-e18fb495-19d4-449f-8149-ef437f676a88 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state building and task_state spawning.
Nov 28 23:02:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Starting migrate_disk_and_power_off {{(pid=74959) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 23:02:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-a901be9e-271e-4bd9-9bed-76af56a540fd req-27360bb3-e655-4421-8b98-f10b7279e7c2 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a901be9e-271e-4bd9-9bed-76af56a540fd req-27360bb3-e655-4421-8b98-f10b7279e7c2 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a901be9e-271e-4bd9-9bed-76af56a540fd req-27360bb3-e655-4421-8b98-f10b7279e7c2 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a901be9e-271e-4bd9-9bed-76af56a540fd req-27360bb3-e655-4421-8b98-f10b7279e7c2 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-a901be9e-271e-4bd9-9bed-76af56a540fd req-27360bb3-e655-4421-8b98-f10b7279e7c2 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:50 user nova-compute[74959]: WARNING nova.compute.manager [req-a901be9e-271e-4bd9-9bed-76af56a540fd req-27360bb3-e655-4421-8b98-f10b7279e7c2 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state active and task_state resize_migrating.
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquired lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance destroyed successfully.
Nov 28 23:02:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30122154-network", "vif_mac": "fa:16:3e:b4:83:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30122154-network", "vif_mac": "fa:16:3e:b4:83:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_vif [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67663953-c8, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58a9cea8-7544-4006-b2c2-20c86a497ae2) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:50 user nova-compute[74959]: INFO os_vif [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8')
Nov 28 23:02:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:50 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f702421-ab04-4cb0-9663-086864c89279]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:02:50 user nova-compute[74959]: No targets found.
Nov 28 23:02:50 user nova-compute[74959]: iSNS:
Nov 28 23:02:50 user nova-compute[74959]: No targets found.
Nov 28 23:02:50 user nova-compute[74959]: STATIC:
Nov 28 23:02:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:02:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:02:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:02:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:02:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:50 user nova-compute[74959]: FIRMWARE:
Nov 28 23:02:50 user nova-compute[74959]: No targets found.
Nov 28 23:02:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:02:50 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:02:50 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f1dd0-c28d-45d7-a646-f2bc9e0b55f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[69874e8b-a020-418d-8d40-359cbbd5d117]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:02:50 user nova-compute[74959]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:50 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:50 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:02:50 user nova-compute[74959]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:50 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:50 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef78db2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9cf35c-9424-4234-93be-44adea8bd213]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6236bc84-b5f6-4d03-9c85-46b73e5caaeb]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bfd8ad-12af-4a49-81bd-69951beb239c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0647444-2f8c-42fd-84c9-ea290d35a49c]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d4cc5c-c211-482a-928e-d83c1b3327a5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddafb9e7-55d3-4d46-bb3a-684f7e4ebda9]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]
Nov 28 23:02:51 user nova-compute[74959]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.
Nov 28 23:02:51 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.network.neutron [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21f6d6-c0c1-4dd8-8a47-28d48e83c0de]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== disconnect_volume: return (333ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Releasing lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:02:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Creating image(s)
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.objects.instance [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.objects.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<94b085b2-b298-4780-be94-21f85c799945> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "030fdf7da2662befb9f447b4544df04186765762" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "030fdf7da2662befb9f447b4544df04186765762" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917_resize/disk /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-33d3ac93-f798-4fc6-a8ba-de8ca0c35b4f req-97c02d30-3d6f-4db7-a4b7-4e45d4e05563 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33d3ac93-f798-4fc6-a8ba-de8ca0c35b4f req-97c02d30-3d6f-4db7-a4b7-4e45d4e05563 service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33d3ac93-f798-4fc6-a8ba-de8ca0c35b4f req-97c02d30-3d6f-4db7-a4b7-4e45d4e05563 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33d3ac93-f798-4fc6-a8ba-de8ca0c35b4f req-97c02d30-3d6f-4db7-a4b7-4e45d4e05563 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-33d3ac93-f798-4fc6-a8ba-de8ca0c35b4f req-97c02d30-3d6f-4db7-a4b7-4e45d4e05563 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:51 user nova-compute[74959]: WARNING nova.compute.manager [req-33d3ac93-f798-4fc6-a8ba-de8ca0c35b4f req-97c02d30-3d6f-4db7-a4b7-4e45d4e05563 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state building and task_state spawning.
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:02:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance spawned successfully.
Nov 28 23:02:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "cp -r /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917_resize/disk /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk" returned: 0 in 1.424s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-changed-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Refreshing instance network info cache due to event network-changed-c60abc7f-b5c7-45ef-a218-d7454c7dbff8. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] Acquiring lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] Acquired lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.network.neutron [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Refreshing network info cache for port c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917_resize/disk.info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk.info {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "cp -r /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917_resize/disk.info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk.info" returned: 0 in 0.054s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:53 user nova-compute[74959]: INFO nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Took 6.61 seconds to spawn the instance on the hypervisor.
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.virt.images [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] 81a9501c-45c7-4462-be38-f8059cd98767 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762.part /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:53 user nova-compute[74959]: INFO nova.compute.manager [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Took 21.92 seconds to build instance.
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7647b755-88ac-4599-8f39-aeaafa123f37 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "e245a015-fc98-4557-8168-5089c3746e79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.022s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:53 user nova-compute[74959]: INFO nova.compute.manager [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Terminating instance
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762.part /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762.converted" returned: 0 in 0.644s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.network.neutron [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updated VIF entry in instance network info cache for port c60abc7f-b5c7-45ef-a218-d7454c7dbff8. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.network.neutron [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-631bfa8d-449f-4bd6-95be-1e8707d1204f req-f2de75dc-aba7-4b8e-b46d-db6303024eb0 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received event network-vif-unplugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-631bfa8d-449f-4bd6-95be-1e8707d1204f req-f2de75dc-aba7-4b8e-b46d-db6303024eb0 service nova] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-631bfa8d-449f-4bd6-95be-1e8707d1204f req-f2de75dc-aba7-4b8e-b46d-db6303024eb0 service nova] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-631bfa8d-449f-4bd6-95be-1e8707d1204f req-f2de75dc-aba7-4b8e-b46d-db6303024eb0 service nova] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-631bfa8d-449f-4bd6-95be-1e8707d1204f req-f2de75dc-aba7-4b8e-b46d-db6303024eb0 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] No waiting events found dispatching network-vif-unplugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-631bfa8d-449f-4bd6-95be-1e8707d1204f req-f2de75dc-aba7-4b8e-b46d-db6303024eb0 service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received event network-vif-unplugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] Releasing lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:53 user nova-compute[74959]: WARNING nova.compute.manager [req-22a94ba0-daa4-45c0-a112-e1b6ed8b0fb5 req-d9e89976-9644-44cf-bc8e-4fed009ae112 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state active and task_state resize_migrating.
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquired lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'info_cache' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG nova.objects.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "030fdf7da2662befb9f447b4544df04186765762" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.759s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Port 67663953-c88b-4b51-88e5-2904a213a0ef binding to destination host user is already ACTIVE {{(pid=74959) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 --force-share --output=json" returned: 0 in 0.221s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "030fdf7da2662befb9f447b4544df04186765762" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "030fdf7da2662befb9f447b4544df04186765762" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Instance destroyed successfully.
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lazy-loading 'resources' on Instance uuid ab7dbb0e-6b7e-4250-b0b9-23307c335494 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2073362192',display_name='tempest-TestVolumeSwap-server-2073362192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2073362192',id=10,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr4hqwyEHqYoVQNT+MJNmmA6EKKdefBhWXvleHaZgLmwamfNJU1wuLK4IhL4LPK4AmeaKhwsSuw1ZV4+Ujgevxt4f43D2QTgMGBVSSK5CH4YeKcHc9kYj8cJFDRdFO+JQ==',key_name='tempest-keypair-464840639',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cf04da378904e228154c55fcbd6447b',ramdisk_id='',reservation_id='r-6it2kxel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2071277782',owner_user_name='tempest-TestVolumeSwap-2071277782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55566c37576a40198a8589b801efc04e',uuid=ab7dbb0e-6b7e-4250-b0b9-23307c335494,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Converting VIF {"id": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "address": "fa:16:3e:c1:44:5b", "network": {"id": "e69e37f5-b4e8-4c17-b4fc-99425486596b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-111394299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf04da378904e228154c55fcbd6447b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap298ec03c-3f", "ovs_interfaceid": "298ec03c-3fde-4afb-a05e-fff5d0b2af54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:44:5b,bridge_name='br-int',has_traffic_filtering=True,id=298ec03c-3fde-4afb-a05e-fff5d0b2af54,network=Network(e69e37f5-b4e8-4c17-b4fc-99425486596b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ec03c-3f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_vif [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:44:5b,bridge_name='br-int',has_traffic_filtering=True,id=298ec03c-3fde-4afb-a05e-fff5d0b2af54,network=Network(e69e37f5-b4e8-4c17-b4fc-99425486596b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ec03c-3f') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap298ec03c-3f, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73e39c96-5344-41f5-a095-7f5766e7aa1b) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: INFO os_vif [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:44:5b,bridge_name='br-int',has_traffic_filtering=True,id=298ec03c-3fde-4afb-a05e-fff5d0b2af54,network=Network(e69e37f5-b4e8-4c17-b4fc-99425486596b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap298ec03c-3f')
Nov 28 23:02:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Deleting instance files /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494_del
Nov 28 23:02:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Deletion of /opt/stack/data/nova/instances/ab7dbb0e-6b7e-4250-b0b9-23307c335494_del complete
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762,backing_fmt=raw /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762,backing_fmt=raw /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk 1073741824" returned: 0 in 0.076s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "030fdf7da2662befb9f447b4544df04186765762" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: INFO nova.compute.manager [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Releasing lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance destroyed successfully.
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'resources' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.objects.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_vif [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapded8a2c4-07, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ac414fa-f4e9-4470-a638-00f909ccc74c) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: INFO os_vif [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07')
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsPoIUeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:54 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e23c4a-3b15-455a-826c-a05bae7bf91a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:02:54 user nova-compute[74959]: No targets found.
Nov 28 23:02:54 user nova-compute[74959]: iSNS:
Nov 28 23:02:54 user nova-compute[74959]: No targets found.
Nov 28 23:02:54 user nova-compute[74959]: STATIC:
Nov 28 23:02:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:02:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:02:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:02:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:02:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:02:54 user nova-compute[74959]: FIRMWARE:
Nov 28 23:02:54 user nova-compute[74959]: No targets found.
Nov 28 23:02:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:02:54 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:02:54 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 --force-share --output=json" returned: 0 in 0.228s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'migration_context' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquired lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG nova.objects.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<94b085b2-b298-4780-be94-21f85c799945> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Rebasing disk image.
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3bce73-aace-437c-881e-377f0dd82a87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae28bcf-f547-461a-8335-262e1bad226b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:54 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:54 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:54 user nova-compute[74959]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:54 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec36fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf'): ({'sde'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Removing single pathed devices sde {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb691d1-4646-4566-876e-b5f1def63100]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e16c76-c733-4365-bcf1-049514a61030]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flushing IO for device /dev/sde {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2caecab-dab1-4991-aa36-a33e68b86391]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efcc810-e840-4638-b451-9cebcd0861b2]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.205s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 -F raw /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea535f-0354-40a4-91d3-b98546a91624]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[890654be-d0bc-4240-b969-2e01aa117eb2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260]
Nov 28 23:02:55 user nova-compute[74959]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260] successful.
Nov 28 23:02:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc798c3-ee44-427b-a149-e1ad2a6f6616]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== disconnect_volume: return (409ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Start _get_guest_xml network_info=[{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsPoIUeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9492b249-758e-4b8f-acfb-f334ef80a9dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4f19256-661e-4d78-bfb7-ed5e50539ebf', 'serial': 'f4f19256-661e-4d78-bfb7-ed5e50539ebf'}, 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '50b3aabf-579f-49cc-a37f-774a94441d56', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'numa_topology' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.objects.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.objects.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsPoIUeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:55 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:55 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:55 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d273010c-3c82-4195-86cd-576eaf85b683]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:02:55 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6c1b3e-47dc-4c09-b74c-fdeed4464706]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf] added
Nov 28 23:02:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[25635a4e-ad10-44bf-9f2e-c64a27c231c5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cded3dd-a704-4990-92d6-3486e735c800]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsPoIUeG {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsPoIUeG" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8408e337-52e0-4a8d-b925-36c2eaa9edce]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CsPoIUeG'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.043s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba903dc-3ff8-4696-b9d5-86f7c096d68b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0cae15-403c-4c60-9d0b-336c093fc389]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:55 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:55 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:55 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Took 0.99 seconds to deallocate network for instance.
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85cb974-0df5-4cd3-9659-aa327cdc8075]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260]
Nov 28 23:02:55 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260] successful.
Nov 28 23:02:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7bbe7-5e8a-4e64-b1f1-43bc08b37c7b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2aa324-a31f-4110-82b1-dcf2eab6705a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:55 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:55 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:55 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:55 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c9844-e8ad-427f-9911-587ee2bd9041]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsPoIUeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Releasing lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c7c92c3-6ad6-4942-9611-bc8a434a8b01 req-f552942e-87db-40df-a6dd-b0da2e5a07cc service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received event network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c7c92c3-6ad6-4942-9611-bc8a434a8b01 req-f552942e-87db-40df-a6dd-b0da2e5a07cc service nova] Acquiring lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c7c92c3-6ad6-4942-9611-bc8a434a8b01 req-f552942e-87db-40df-a6dd-b0da2e5a07cc service nova] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c7c92c3-6ad6-4942-9611-bc8a434a8b01 req-f552942e-87db-40df-a6dd-b0da2e5a07cc service nova] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c7c92c3-6ad6-4942-9611-bc8a434a8b01 req-f552942e-87db-40df-a6dd-b0da2e5a07cc service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] No waiting events found dispatching network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:55 user nova-compute[74959]: WARNING nova.compute.manager [req-8c7c92c3-6ad6-4942-9611-bc8a434a8b01 req-f552942e-87db-40df-a6dd-b0da2e5a07cc service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received unexpected event network-vif-plugged-298ec03c-3fde-4afb-a05e-fff5d0b2af54 for instance with vm_state deleted and task_state None.
Nov 28 23:02:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c7c92c3-6ad6-4942-9611-bc8a434a8b01 req-f552942e-87db-40df-a6dd-b0da2e5a07cc service nova] [instance: ab7dbb0e-6b7e-4250-b0b9-23307c335494] Received event network-vif-deleted-298ec03c-3fde-4afb-a05e-fff5d0b2af54 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.utils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb9676f-0eda-4d21-a411-3491d8b0221c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebe5d34-f659-4a94-8774-e4bfb405937f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4eb7b9-3b4c-450a-bea9-df2778c92d7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d8111d-713b-45aa-9430-42f2c65ffacc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:02:55 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:02:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa2ba7d-8b85-468c-a910-ca568430cf2f]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:02:55 user nova-compute[74959]: DEBUG os_brick.utils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:56 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Deleted allocations for instance ab7dbb0e-6b7e-4250-b0b9-23307c335494
Nov 28 23:02:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02218b84-5807-4719-bdb3-19e8c50572ea tempest-TestVolumeSwap-2071277782 tempest-TestVolumeSwap-2071277782-project-member] Lock "ab7dbb0e-6b7e-4250-b0b9-23307c335494" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.105s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23566336237643063', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566336237643063', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'pci_devices' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.objects.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:02:56 user nova-compute[74959]:   <uuid>9492b249-758e-4b8f-acfb-f334ef80a9dd</uuid>
Nov 28 23:02:56 user nova-compute[74959]:   <name>instance-00000006</name>
Nov 28 23:02:56 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:02:56 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:02:56 user nova-compute[74959]:   <metadata>
Nov 28 23:02:56 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:56 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:02:56 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeTestJSON-server-1150032391</nova:name>
Nov 28 23:02:56 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:02:55</nova:creationTime>
Nov 28 23:02:56 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:02:56 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:02:56 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:02:56 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:02:56 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:56 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:56 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:02:56 user nova-compute[74959]:       <nova:owner>
Nov 28 23:02:56 user nova-compute[74959]:         <nova:user uuid="ba2c8fce9ab041ba928f65f59468683e">tempest-AttachVolumeTestJSON-803300239-project-member</nova:user>
Nov 28 23:02:56 user nova-compute[74959]:         <nova:project uuid="c95b70a9bba84ebc95d6d7aea0d8c649">tempest-AttachVolumeTestJSON-803300239</nova:project>
Nov 28 23:02:56 user nova-compute[74959]:       </nova:owner>
Nov 28 23:02:56 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:02:56 user nova-compute[74959]:       <nova:ports>
Nov 28 23:02:56 user nova-compute[74959]:         <nova:port uuid="ded8a2c4-07d6-440e-9110-4c2a7b2738f2">
Nov 28 23:02:56 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:02:56 user nova-compute[74959]:         </nova:port>
Nov 28 23:02:56 user nova-compute[74959]:       </nova:ports>
Nov 28 23:02:56 user nova-compute[74959]:     </nova:instance>
Nov 28 23:02:56 user nova-compute[74959]:   </metadata>
Nov 28 23:02:56 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:02:56 user nova-compute[74959]:     <system>
Nov 28 23:02:56 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:02:56 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:02:56 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:02:56 user nova-compute[74959]:       <entry name="serial">9492b249-758e-4b8f-acfb-f334ef80a9dd</entry>
Nov 28 23:02:56 user nova-compute[74959]:       <entry name="uuid">9492b249-758e-4b8f-acfb-f334ef80a9dd</entry>
Nov 28 23:02:56 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:02:56 user nova-compute[74959]:     </system>
Nov 28 23:02:56 user nova-compute[74959]:   </sysinfo>
Nov 28 23:02:56 user nova-compute[74959]:   <os>
Nov 28 23:02:56 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:02:56 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:02:56 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:02:56 user nova-compute[74959]:   </os>
Nov 28 23:02:56 user nova-compute[74959]:   <features>
Nov 28 23:02:56 user nova-compute[74959]:     <acpi/>
Nov 28 23:02:56 user nova-compute[74959]:     <apic/>
Nov 28 23:02:56 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:02:56 user nova-compute[74959]:   </features>
Nov 28 23:02:56 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:02:56 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:02:56 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:02:56 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:02:56 user nova-compute[74959]:   </clock>
Nov 28 23:02:56 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:02:56 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:02:56 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:02:56 user nova-compute[74959]:   </cpu>
Nov 28 23:02:56 user nova-compute[74959]:   <devices>
Nov 28 23:02:56 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:02:56 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:02:56 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk"/>
Nov 28 23:02:56 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:02:56 user nova-compute[74959]:     </disk>
Nov 28 23:02:56 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:02:56 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:02:56 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:02:56 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:02:56 user nova-compute[74959]:       <serial>f4f19256-661e-4d78-bfb7-ed5e50539ebf</serial>
Nov 28 23:02:56 user nova-compute[74959]:     </disk>
Nov 28 23:02:56 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:02:56 user nova-compute[74959]:       <mac address="fa:16:3e:69:f4:ad"/>
Nov 28 23:02:56 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:02:56 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:02:56 user nova-compute[74959]:       <target dev="tapded8a2c4-07"/>
Nov 28 23:02:56 user nova-compute[74959]:     </interface>
Nov 28 23:02:56 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:02:56 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/console.log" append="off"/>
Nov 28 23:02:56 user nova-compute[74959]:     </serial>
Nov 28 23:02:56 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:02:56 user nova-compute[74959]:     <video>
Nov 28 23:02:56 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:02:56 user nova-compute[74959]:     </video>
Nov 28 23:02:56 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:02:56 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:02:56 user nova-compute[74959]:     </rng>
Nov 28 23:02:56 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:02:56 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:02:56 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:02:56 user nova-compute[74959]:     </memballoon>
Nov 28 23:02:56 user nova-compute[74959]:   </devices>
Nov 28 23:02:56 user nova-compute[74959]: </domain>
Nov 28 23:02:56 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.objects.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 -F raw /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk" returned: 0 in 2.310s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Ensure instance console log exists: /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Start _get_guest_xml network_info=[{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='693fcec1acc15c92f7664649705a5b9e',container_format='bare',created_at=2023-11-28T23:00:43Z,direct_url=<?>,disk_format='qcow2',id=81a9501c-45c7-4462-be38-f8059cd98767,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1352161345-shelved',owner='bef225be98f448b69f250a21c002c237',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T23:00:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OulVWEAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '94b085b2-b298-4780-be94-21f85c799945', 'attached_at': '', 'detached_at': '', 'volume_id': '18f67820-210f-46b7-8bf3-4b786b77b966', 'serial': '18f67820-210f-46b7-8bf3-4b786b77b966'}, 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'd97f1f7e-2376-444c-970f-a4a27eacfd9d', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:02:57 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:57 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='693fcec1acc15c92f7664649705a5b9e',container_format='bare',created_at=2023-11-28T23:00:43Z,direct_url=<?>,disk_format='qcow2',id=81a9501c-45c7-4462-be38-f8059cd98767,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1352161345-shelved',owner='bef225be98f448b69f250a21c002c237',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T23:00:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.objects.instance [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.objects.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<94b085b2-b298-4780-be94-21f85c799945> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OulVWEAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:02:57 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:57 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:02:57 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab38dac2-aee9-4fa6-a2b2-5aa726b15b72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:02:57 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce98868-595f-4f29-b772-4cfebd055b0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966] added
Nov 28 23:02:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e3ea44-6c34-4ec1-b55b-d104718db485]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a1a128-0546-47f9-aa82-dddeb9dbc028]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OulVWEAJ {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OulVWEAJ" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b94612-92f8-456f-ad53-eb6f4ccd94e4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OulVWEAJ'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[033df0e6-1c88-4b31-a6ad-d6422bd05792]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Cannot resize image /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'migration_context' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef09045a-4408-4da5-aa3e-2d6249c5cea8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.objects.base [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_vif [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2570ecb9-1128-584b-a1cb-dd1ea8f8f7bb', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapded8a2c4-07, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapded8a2c4-07, col_values=(('qos', UUID('1eae101c-07d1-4d7d-8a44-ab6db192f5d5')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapded8a2c4-07, col_values=(('external_ids', {'iface-id': 'ded8a2c4-07d6-440e-9110-4c2a7b2738f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:f4:ad', 'vm-uuid': '9492b249-758e-4b8f-acfb-f334ef80a9dd'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:57 user nova-compute[74959]: INFO os_vif [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07')
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8304abdb-0750-48ae-bd0c-4aa20b9c559b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966, portal: 172.16.0.220,3260]
Nov 28 23:02:57 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966, portal: 172.16.0.220,3260] successful.
Nov 28 23:02:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea83ed90-8ae1-4af7-a2a2-9393bd98676d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7ad84f-51c3-4e23-bb7c-65efa1cd23ca]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:02:57 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:02:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f4c45-79d2-43f3-9546-7db308557342]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:02:57 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-3a849056-fca6-4b35-8ad6-f95d26fba467 req-35fc9066-ccd4-4fa1-814f-9d3c656b162d service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received event network-changed-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-3a849056-fca6-4b35-8ad6-f95d26fba467 req-35fc9066-ccd4-4fa1-814f-9d3c656b162d service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Refreshing instance network info cache due to event network-changed-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3a849056-fca6-4b35-8ad6-f95d26fba467 req-35fc9066-ccd4-4fa1-814f-9d3c656b162d service nova] Acquiring lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3a849056-fca6-4b35-8ad6-f95d26fba467 req-35fc9066-ccd4-4fa1-814f-9d3c656b162d service nova] Acquired lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-3a849056-fca6-4b35-8ad6-f95d26fba467 req-35fc9066-ccd4-4fa1-814f-9d3c656b162d service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Refreshing network info cache for port f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OulVWEAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23364316361323734', 'path': '/dev/sdd'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364316361323734', 'path': '/dev/sdd'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1352161345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1352161345',id=5,image_ref='81a9501c-45c7-4462-be38-f8059cd98767',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-271008495',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-oyejk6uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member',shelved_at='2023-11-28T23:00:48.813819',shelved_host='user',shelved_image_id='81a9501c-45c7-4462-be38-f8059cd98767'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=94b085b2-b298-4780-be94-21f85c799945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'pci_devices' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.objects.base [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<94b085b2-b298-4780-be94-21f85c799945> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:02:58 user nova-compute[74959]:   <uuid>94b085b2-b298-4780-be94-21f85c799945</uuid>
Nov 28 23:02:58 user nova-compute[74959]:   <name>instance-00000005</name>
Nov 28 23:02:58 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:02:58 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:02:58 user nova-compute[74959]:   <metadata>
Nov 28 23:02:58 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:02:58 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:02:58 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1352161345</nova:name>
Nov 28 23:02:58 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:02:57</nova:creationTime>
Nov 28 23:02:58 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:02:58 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:02:58 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:02:58 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:02:58 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:02:58 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:02:58 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:02:58 user nova-compute[74959]:       <nova:owner>
Nov 28 23:02:58 user nova-compute[74959]:         <nova:user uuid="ecd0185bcfae4e058dade500ad82dbd2">tempest-AttachVolumeShelveTestJSON-533572635-project-member</nova:user>
Nov 28 23:02:58 user nova-compute[74959]:         <nova:project uuid="bef225be98f448b69f250a21c002c237">tempest-AttachVolumeShelveTestJSON-533572635</nova:project>
Nov 28 23:02:58 user nova-compute[74959]:       </nova:owner>
Nov 28 23:02:58 user nova-compute[74959]:       <nova:root type="image" uuid="81a9501c-45c7-4462-be38-f8059cd98767"/>
Nov 28 23:02:58 user nova-compute[74959]:       <nova:ports>
Nov 28 23:02:58 user nova-compute[74959]:         <nova:port uuid="c60abc7f-b5c7-45ef-a218-d7454c7dbff8">
Nov 28 23:02:58 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 23:02:58 user nova-compute[74959]:         </nova:port>
Nov 28 23:02:58 user nova-compute[74959]:       </nova:ports>
Nov 28 23:02:58 user nova-compute[74959]:     </nova:instance>
Nov 28 23:02:58 user nova-compute[74959]:   </metadata>
Nov 28 23:02:58 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:02:58 user nova-compute[74959]:     <system>
Nov 28 23:02:58 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:02:58 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:02:58 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:02:58 user nova-compute[74959]:       <entry name="serial">94b085b2-b298-4780-be94-21f85c799945</entry>
Nov 28 23:02:58 user nova-compute[74959]:       <entry name="uuid">94b085b2-b298-4780-be94-21f85c799945</entry>
Nov 28 23:02:58 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:02:58 user nova-compute[74959]:     </system>
Nov 28 23:02:58 user nova-compute[74959]:   </sysinfo>
Nov 28 23:02:58 user nova-compute[74959]:   <os>
Nov 28 23:02:58 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:02:58 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:02:58 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:02:58 user nova-compute[74959]:   </os>
Nov 28 23:02:58 user nova-compute[74959]:   <features>
Nov 28 23:02:58 user nova-compute[74959]:     <acpi/>
Nov 28 23:02:58 user nova-compute[74959]:     <apic/>
Nov 28 23:02:58 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:02:58 user nova-compute[74959]:   </features>
Nov 28 23:02:58 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:02:58 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:02:58 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:02:58 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:02:58 user nova-compute[74959]:   </clock>
Nov 28 23:02:58 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:02:58 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:02:58 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:02:58 user nova-compute[74959]:   </cpu>
Nov 28 23:02:58 user nova-compute[74959]:   <devices>
Nov 28 23:02:58 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:02:58 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:02:58 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk"/>
Nov 28 23:02:58 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:02:58 user nova-compute[74959]:     </disk>
Nov 28 23:02:58 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:02:58 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:02:58 user nova-compute[74959]:       <source dev="/dev/sdd"/>
Nov 28 23:02:58 user nova-compute[74959]:       <target dev="vdc" bus="virtio"/>
Nov 28 23:02:58 user nova-compute[74959]:       <serial>18f67820-210f-46b7-8bf3-4b786b77b966</serial>
Nov 28 23:02:58 user nova-compute[74959]:     </disk>
Nov 28 23:02:58 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:02:58 user nova-compute[74959]:       <mac address="fa:16:3e:39:09:03"/>
Nov 28 23:02:58 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:02:58 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:02:58 user nova-compute[74959]:       <target dev="tapc60abc7f-b5"/>
Nov 28 23:02:58 user nova-compute[74959]:     </interface>
Nov 28 23:02:58 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:02:58 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/console.log" append="off"/>
Nov 28 23:02:58 user nova-compute[74959]:     </serial>
Nov 28 23:02:58 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:02:58 user nova-compute[74959]:     <video>
Nov 28 23:02:58 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:02:58 user nova-compute[74959]:     </video>
Nov 28 23:02:58 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:02:58 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:02:58 user nova-compute[74959]:     </rng>
Nov 28 23:02:58 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:02:58 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:02:58 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:02:58 user nova-compute[74959]:     </memballoon>
Nov 28 23:02:58 user nova-compute[74959]:   </devices>
Nov 28 23:02:58 user nova-compute[74959]: </domain>
Nov 28 23:02:58 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1352161345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1352161345',id=5,image_ref='81a9501c-45c7-4462-be38-f8059cd98767',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-271008495',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-oyejk6uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member',shelved_at='2023-11-28T23:00:48.813819',shelved_host='user',shelved_image_id='81a9501c-45c7-4462-be38-f8059cd98767'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=94b085b2-b298-4780-be94-21f85c799945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG os_vif [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b6890b6-3ae2-5e7f-89ab-3c0875182ff7', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc60abc7f-b5, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc60abc7f-b5, col_values=(('qos', UUID('555632b5-622b-4fd4-9317-aaf4a590400b')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc60abc7f-b5, col_values=(('external_ids', {'iface-id': 'c60abc7f-b5c7-45ef-a218-d7454c7dbff8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:09:03', 'vm-uuid': '94b085b2-b298-4780-be94-21f85c799945'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: INFO os_vif [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5')
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No VIF found with MAC fa:16:3e:39:09:03, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "6f965725-6fae-4b8a-abe2-801d29c8a21e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:59 user nova-compute[74959]: INFO nova.compute.manager [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Terminating instance
Nov 28 23:02:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG nova.network.neutron [req-3a849056-fca6-4b35-8ad6-f95d26fba467 req-35fc9066-ccd4-4fa1-814f-9d3c656b162d service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Updated VIF entry in instance network info cache for port f2eb1d0a-b86d-4e1f-93b3-6db50ebafded. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG nova.network.neutron [req-3a849056-fca6-4b35-8ad6-f95d26fba467 req-35fc9066-ccd4-4fa1-814f-9d3c656b162d service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Updating instance_info_cache with network_info: [{"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3a849056-fca6-4b35-8ad6-f95d26fba467 req-35fc9066-ccd4-4fa1-814f-9d3c656b162d service nova] Releasing lock "refresh_cache-6f965725-6fae-4b8a-abe2-801d29c8a21e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-65e5be18-efc7-4499-96bb-8ac7201f3c4e req-7e3e1318-2110-4269-a48c-17e0a6c51cec service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received event network-vif-unplugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-65e5be18-efc7-4499-96bb-8ac7201f3c4e req-7e3e1318-2110-4269-a48c-17e0a6c51cec service nova] Acquiring lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-65e5be18-efc7-4499-96bb-8ac7201f3c4e req-7e3e1318-2110-4269-a48c-17e0a6c51cec service nova] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-65e5be18-efc7-4499-96bb-8ac7201f3c4e req-7e3e1318-2110-4269-a48c-17e0a6c51cec service nova] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-65e5be18-efc7-4499-96bb-8ac7201f3c4e req-7e3e1318-2110-4269-a48c-17e0a6c51cec service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] No waiting events found dispatching network-vif-unplugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-65e5be18-efc7-4499-96bb-8ac7201f3c4e req-7e3e1318-2110-4269-a48c-17e0a6c51cec service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received event network-vif-unplugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:02:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:03:00 user nova-compute[74959]: WARNING nova.compute.manager [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state stopped and task_state powering-on.
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:03:00 user nova-compute[74959]: WARNING nova.compute.manager [req-647107e7-1ffd-4b2d-9ee1-be70fe4c5f6f req-c286f50e-8638-40e9-8c49-d0265720cc6b service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state stopped and task_state powering-on.
Nov 28 23:03:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Instance destroyed successfully.
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'resources' on Instance uuid 6f965725-6fae-4b8a-abe2-801d29c8a21e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109714954',display_name='tempest-AttachVolumeNegativeTest-server-109714954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109714954',id=13,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtrglnvlf5TG5fusNreonhV0Ot8vcCYFmufhN08lYfpAI5q4PzrJ81l5XgFXf+xi+7zyhkgfw+srWipPjXSewFxxPlNOa8H1XnRoConPnyNvYa3xDlg4d442dgJg72R9Q==',key_name='tempest-keypair-974326308',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-44r06lj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=6f965725-6fae-4b8a-abe2-801d29c8a21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "address": "fa:16:3e:67:61:f5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eb1d0a-b8", "ovs_interfaceid": "f2eb1d0a-b86d-4e1f-93b3-6db50ebafded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:f5,bridge_name='br-int',has_traffic_filtering=True,id=f2eb1d0a-b86d-4e1f-93b3-6db50ebafded,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eb1d0a-b8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG os_vif [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:f5,bridge_name='br-int',has_traffic_filtering=True,id=f2eb1d0a-b86d-4e1f-93b3-6db50ebafded,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eb1d0a-b8') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2eb1d0a-b8, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b27a73d6-6845-4d01-b723-dca9cbfd5705) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: INFO os_vif [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:61:f5,bridge_name='br-int',has_traffic_filtering=True,id=f2eb1d0a-b86d-4e1f-93b3-6db50ebafded,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eb1d0a-b8')
Nov 28 23:03:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Deleting instance files /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e_del
Nov 28 23:03:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Deletion of /opt/stack/data/nova/instances/6f965725-6fae-4b8a-abe2-801d29c8a21e_del complete
Nov 28 23:03:00 user nova-compute[74959]: INFO nova.compute.manager [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Took 1.69 seconds to destroy the instance on the hypervisor.
Nov 28 23:03:00 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received event network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Acquiring lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] No waiting events found dispatching network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:03:01 user nova-compute[74959]: WARNING nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received unexpected event network-vif-plugged-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded for instance with vm_state active and task_state deleting.
Nov 28 23:03:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] No waiting events found dispatching network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:03:01 user nova-compute[74959]: WARNING nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received unexpected event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 23:03:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] Lock "94b085b2-b298-4780-be94-21f85c799945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] No waiting events found dispatching network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:03:01 user nova-compute[74959]: WARNING nova.compute.manager [req-9ee2d73e-4ca5-4aef-8b26-85d1922bc6fc req-e299e9c2-31d5-4df0-8681-a5eae05fc905 service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received unexpected event network-vif-plugged-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 23:03:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:03:01 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Took 1.01 seconds to deallocate network for instance.
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:02 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:03:02 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:03:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:02 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Deleted allocations for instance 6f965725-6fae-4b8a-abe2-801d29c8a21e
Nov 28 23:03:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0c3cafc4-9433-4caa-b838-9d0518858af7 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "6f965725-6fae-4b8a-abe2-801d29c8a21e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.334s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:03:02 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance rebooted successfully.
Nov 28 23:03:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-f3f5e053-a980-4f08-9a28-3464b283ce72 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:03:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-f63e0351-fb35-42b0-bfb8-41157ebe58d4 req-63a8eb2e-4332-4839-92f5-287318289550 service nova] [instance: 6f965725-6fae-4b8a-abe2-801d29c8a21e] Received event network-vif-deleted-f2eb1d0a-b86d-4e1f-93b3-6db50ebafded {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:03:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:03:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:03:03 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance spawned successfully.
Nov 28 23:03:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:03:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32737902-ba6c-413b-a0f8-20e61f0bec77 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.817s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Starting finish_migration {{(pid=74959) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 23:03:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance directory exists: not creating {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 23:03:05 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Creating image(s)
Nov 28 23:03:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk. size=21474836480 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk 21474836480 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk 21474836480" returned: 0 in 0.368s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Ensure instance console log exists: /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Start _get_guest_xml network_info=[{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30122154-network", "vif_mac": "fa:16:3e:b4:83:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7011df2d-f2c5-48ba-8d4c-d0539c235917', 'attached_at': '2023-11-28T23:03:06.000000', 'detached_at': '', 'volume_id': 'b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'serial': 'b5e6b154-a7cf-41bf-b0c8-a559df5579b2'}, 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '0351e698-56fe-435e-943f-4d53927edf6e', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:03:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:03:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:03:06 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:03:06 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:03:06 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6642e-ce9d-4638-b835-224417c0515a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:03:06 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d613ca7e-05e2-4d95-a908-1274fa7635b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2] added
Nov 28 23:03:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2776e5a8-6330-4bd7-a1d9-c78eb966a1eb]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52de987-abc6-453f-a10b-9c42adf255dc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:03:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGrXlNba {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGrXlNba" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[280f8134-61ce-45a9-8d32-9ac9841de5a3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGrXlNba'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.132s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d75398c-3da0-4238-8634-9b4b8cf4350b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[18881f67-fac8-486d-a56a-ae8777675bf7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:03:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:03:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbf7cc1-3c0b-4d1e-a022-8534f9daba66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]
Nov 28 23:03:07 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.
Nov 28 23:03:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.050s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b580e2-d8d9-4a7a-8f1d-8762401dd533]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9130fa-fc9d-4df6-928d-53497b1fead5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:03:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:03:07 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:03:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.487s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff59e60-47db-4c8d-90ca-c7afe0b165b4]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:03:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.527s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '26438343433343563', 'path': '/dev/sde'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438343433343563', 'path': '/dev/sde'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30122154-network", "vif_mac": "fa:16:3e:b4:83:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30122154-network", "vif_mac": "fa:16:3e:b4:83:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:03:08 user nova-compute[74959]:   <uuid>7011df2d-f2c5-48ba-8d4c-d0539c235917</uuid>
Nov 28 23:03:08 user nova-compute[74959]:   <name>instance-00000004</name>
Nov 28 23:03:08 user nova-compute[74959]:   <memory>2097152</memory>
Nov 28 23:03:08 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:03:08 user nova-compute[74959]:   <metadata>
Nov 28 23:03:08 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:03:08 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:03:08 user nova-compute[74959]:       <nova:name>tempest-ServerActionsTestOtherB-server-1175671381</nova:name>
Nov 28 23:03:08 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:03:06</nova:creationTime>
Nov 28 23:03:08 user nova-compute[74959]:       <nova:flavor name="m1.small">
Nov 28 23:03:08 user nova-compute[74959]:         <nova:memory>2048</nova:memory>
Nov 28 23:03:08 user nova-compute[74959]:         <nova:disk>20</nova:disk>
Nov 28 23:03:08 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:03:08 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:03:08 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:03:08 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:03:08 user nova-compute[74959]:       <nova:owner>
Nov 28 23:03:08 user nova-compute[74959]:         <nova:user uuid="911d51b00a8e442cbe38d5e511edba81">tempest-ServerActionsTestOtherB-152667612-project-member</nova:user>
Nov 28 23:03:08 user nova-compute[74959]:         <nova:project uuid="5e566d89eec64455b5bdb1b105bfe9a0">tempest-ServerActionsTestOtherB-152667612</nova:project>
Nov 28 23:03:08 user nova-compute[74959]:       </nova:owner>
Nov 28 23:03:08 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:03:08 user nova-compute[74959]:       <nova:ports>
Nov 28 23:03:08 user nova-compute[74959]:         <nova:port uuid="67663953-c88b-4b51-88e5-2904a213a0ef">
Nov 28 23:03:08 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 23:03:08 user nova-compute[74959]:         </nova:port>
Nov 28 23:03:08 user nova-compute[74959]:       </nova:ports>
Nov 28 23:03:08 user nova-compute[74959]:     </nova:instance>
Nov 28 23:03:08 user nova-compute[74959]:   </metadata>
Nov 28 23:03:08 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:03:08 user nova-compute[74959]:     <system>
Nov 28 23:03:08 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:03:08 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:03:08 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:03:08 user nova-compute[74959]:       <entry name="serial">7011df2d-f2c5-48ba-8d4c-d0539c235917</entry>
Nov 28 23:03:08 user nova-compute[74959]:       <entry name="uuid">7011df2d-f2c5-48ba-8d4c-d0539c235917</entry>
Nov 28 23:03:08 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:03:08 user nova-compute[74959]:     </system>
Nov 28 23:03:08 user nova-compute[74959]:   </sysinfo>
Nov 28 23:03:08 user nova-compute[74959]:   <os>
Nov 28 23:03:08 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:03:08 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:03:08 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:03:08 user nova-compute[74959]:   </os>
Nov 28 23:03:08 user nova-compute[74959]:   <features>
Nov 28 23:03:08 user nova-compute[74959]:     <acpi/>
Nov 28 23:03:08 user nova-compute[74959]:     <apic/>
Nov 28 23:03:08 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:03:08 user nova-compute[74959]:   </features>
Nov 28 23:03:08 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:03:08 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:03:08 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:03:08 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:03:08 user nova-compute[74959]:   </clock>
Nov 28 23:03:08 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:03:08 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:03:08 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:03:08 user nova-compute[74959]:   </cpu>
Nov 28 23:03:08 user nova-compute[74959]:   <devices>
Nov 28 23:03:08 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:03:08 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:03:08 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk"/>
Nov 28 23:03:08 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:03:08 user nova-compute[74959]:     </disk>
Nov 28 23:03:08 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:03:08 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:03:08 user nova-compute[74959]:       <source dev="/dev/sde"/>
Nov 28 23:03:08 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:03:08 user nova-compute[74959]:       <serial>b5e6b154-a7cf-41bf-b0c8-a559df5579b2</serial>
Nov 28 23:03:08 user nova-compute[74959]:     </disk>
Nov 28 23:03:08 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:03:08 user nova-compute[74959]:       <mac address="fa:16:3e:b4:83:ed"/>
Nov 28 23:03:08 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:03:08 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:03:08 user nova-compute[74959]:       <target dev="tap67663953-c8"/>
Nov 28 23:03:08 user nova-compute[74959]:     </interface>
Nov 28 23:03:08 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:03:08 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/console.log" append="off"/>
Nov 28 23:03:08 user nova-compute[74959]:     </serial>
Nov 28 23:03:08 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:03:08 user nova-compute[74959]:     <video>
Nov 28 23:03:08 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:03:08 user nova-compute[74959]:     </video>
Nov 28 23:03:08 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:03:08 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:03:08 user nova-compute[74959]:     </rng>
Nov 28 23:03:08 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:03:08 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:03:08 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:03:08 user nova-compute[74959]:     </memballoon>
Nov 28 23:03:08 user nova-compute[74959]:   </devices>
Nov 28 23:03:08 user nova-compute[74959]: </domain>
Nov 28 23:03:08 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30122154-network", "vif_mac": "fa:16:3e:b4:83:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30122154-network", "vif_mac": "fa:16:3e:b4:83:ed"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG os_vif [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b275aac-4ead-5f59-b12c-ac3d1ffce5b1', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67663953-c8, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67663953-c8, col_values=(('qos', UUID('fbfc5c8a-946f-4909-9879-415c4c52d3c2')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67663953-c8, col_values=(('external_ids', {'iface-id': '67663953-c88b-4b51-88e5-2904a213a0ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:83:ed', 'vm-uuid': '7011df2d-f2c5-48ba-8d4c-d0539c235917'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:08 user nova-compute[74959]: INFO os_vif [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8')
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:03:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] No VIF found with MAC fa:16:3e:b4:83:ed, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-8ca7e39c-a4a2-45b3-b587-233da5db1e5c req-145f6ced-3b88-4ece-ab3c-48724c2b0645 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8ca7e39c-a4a2-45b3-b587-233da5db1e5c req-145f6ced-3b88-4ece-ab3c-48724c2b0645 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8ca7e39c-a4a2-45b3-b587-233da5db1e5c req-145f6ced-3b88-4ece-ab3c-48724c2b0645 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8ca7e39c-a4a2-45b3-b587-233da5db1e5c req-145f6ced-3b88-4ece-ab3c-48724c2b0645 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-8ca7e39c-a4a2-45b3-b587-233da5db1e5c req-145f6ced-3b88-4ece-ab3c-48724c2b0645 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:03:10 user nova-compute[74959]: WARNING nova.compute.manager [req-8ca7e39c-a4a2-45b3-b587-233da5db1e5c req-145f6ced-3b88-4ece-ab3c-48724c2b0645 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state active and task_state resize_finish.
Nov 28 23:03:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-2ce6aadd-0ec9-4a52-95e6-3e1f52d72491 req-5277bbea-b1b4-4557-8659-fd68bfbc3ea3 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:03:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2ce6aadd-0ec9-4a52-95e6-3e1f52d72491 req-5277bbea-b1b4-4557-8659-fd68bfbc3ea3 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2ce6aadd-0ec9-4a52-95e6-3e1f52d72491 req-5277bbea-b1b4-4557-8659-fd68bfbc3ea3 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2ce6aadd-0ec9-4a52-95e6-3e1f52d72491 req-5277bbea-b1b4-4557-8659-fd68bfbc3ea3 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-2ce6aadd-0ec9-4a52-95e6-3e1f52d72491 req-5277bbea-b1b4-4557-8659-fd68bfbc3ea3 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:03:12 user nova-compute[74959]: WARNING nova.compute.manager [req-2ce6aadd-0ec9-4a52-95e6-3e1f52d72491 req-5277bbea-b1b4-4557-8659-fd68bfbc3ea3 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state active and task_state resize_finish.
Nov 28 23:03:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:03:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance running successfully.
Nov 28 23:03:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Failed to set time: agent not configured {{(pid=74959) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 23:03:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cbb5a09a-1758-4af1-a8eb-0361fa701bdd tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] finish_migration finished successfully. {{(pid=74959) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 23:03:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:03:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:03:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:03:33 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 94b085b2-b298-4780-be94-21f85c799945] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:03:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:34 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [{"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:03:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-94b085b2-b298-4780-be94-21f85c799945" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:03:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:03:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:03:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:03:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=25.46526336669922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Applying migration context for instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 as it has an incoming, in-progress migration b318f89d-2e43-487c-9893-9dd914b299ab. Migration status is finished {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 23:03:42 user nova-compute[74959]: INFO nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating resource usage from migration b318f89d-2e43-487c-9893-9dd914b299ab
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d339c51b-2c03-4ac9-800f-b5dc053e0585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 73fd8da6-d3c7-4401-a5cb-18365b030aa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 94b085b2-b298-4780-be94-21f85c799945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Migration b318f89d-2e43-487c-9893-9dd914b299ab is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:03:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:03:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:03:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:03:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:50 user nova-compute[74959]: INFO nova.compute.manager [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Detaching volume 9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:03:51 user nova-compute[74959]: INFO nova.virt.block_device [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Attempting to driver detach volume 9541c8fb-4ccf-4814-9d42-d778e411bf8f from mountpoint /dev/vdb
Nov 28 23:03:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Attempting to detach device vdb from instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:03:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:03:51 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:03:51 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:03:51 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:03:51 user nova-compute[74959]:   <serial>9541c8fb-4ccf-4814-9d42-d778e411bf8f</serial>
Nov 28 23:03:51 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:03:51 user nova-compute[74959]: </disk>
Nov 28 23:03:51 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:03:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully detached device vdb from instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe from the persistent domain config.
Nov 28 23:03:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:03:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:03:51 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:03:51 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:03:51 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:03:51 user nova-compute[74959]:   <serial>9541c8fb-4ccf-4814-9d42-d778e411bf8f</serial>
Nov 28 23:03:51 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:03:51 user nova-compute[74959]: </disk>
Nov 28 23:03:51 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:03:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:03:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:03:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:03:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:03:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:03:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:03:59 user nova-compute[74959]: INFO nova.compute.claims [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Claim successful on node user
Nov 28 23:03:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG nova.network.neutron [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:04:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:04:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:04:00 user nova-compute[74959]: INFO nova.virt.block_device [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Booting with volume 858e5775-3686-4c19-b158-a2019e464c3f at /dev/vda
Nov 28 23:04:00 user nova-compute[74959]: DEBUG nova.policy [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a20b8445a0a744588f59526545b4bc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c538561f8446748937abce99e7eddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG os_brick.utils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71cbab2-b66b-4685-a90c-fbd0ae6f675a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dc5b92-f748-4402-a459-d0c6e9f88a0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8360a69-6ea4-4497-9987-d2af00639acd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[87abbd8e-c533-4927-8483-4d2077f18b8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:00 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:04:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9a3293-8057-48ae-80c2-5b264df9e331]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG os_brick.utils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updating existing volume attachment record: 4850f549-e846-4b0e-8b6e-fc0b06ac2ff6 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:04:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Successfully created port: 5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:04:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Successfully updated port: 5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquired lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-fd6a9242-ab58-4795-a46d-49afe8f1c642 req-f4661cb4-b836-493f-8546-0295801c4f84 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-changed-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-fd6a9242-ab58-4795-a46d-49afe8f1c642 req-f4661cb4-b836-493f-8546-0295801c4f84 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Refreshing instance network info cache due to event network-changed-5ced9d93-efc5-4031-8356-265e81b5884f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fd6a9242-ab58-4795-a46d-49afe8f1c642 req-f4661cb4-b836-493f-8546-0295801c4f84 service nova] Acquiring lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updating instance_info_cache with network_info: [{"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Releasing lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance network_info: |[{"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fd6a9242-ab58-4795-a46d-49afe8f1c642 req-f4661cb4-b836-493f-8546-0295801c4f84 service nova] Acquired lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-fd6a9242-ab58-4795-a46d-49afe8f1c642 req-f4661cb4-b836-493f-8546-0295801c4f84 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Refreshing network info cache for port 5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:04 user nova-compute[74959]: DEBUG nova.network.neutron [req-fd6a9242-ab58-4795-a46d-49afe8f1c642 req-f4661cb4-b836-493f-8546-0295801c4f84 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updated VIF entry in instance network info cache for port 5ced9d93-efc5-4031-8356-265e81b5884f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:04:04 user nova-compute[74959]: DEBUG nova.network.neutron [req-fd6a9242-ab58-4795-a46d-49afe8f1c642 req-f4661cb4-b836-493f-8546-0295801c4f84 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updating instance_info_cache with network_info: [{"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fd6a9242-ab58-4795-a46d-49afe8f1c642 req-f4661cb4-b836-493f-8546-0295801c4f84 service nova] Releasing lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:04:07 user nova-compute[74959]: INFO nova.compute.claims [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Claim successful on node user
Nov 28 23:04:07 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:04:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:04:07 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:04:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:04:08 user nova-compute[74959]: INFO nova.virt.block_device [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Booting with volume 4c60692e-a677-4060-a1b8-b1a2c27068fa at /dev/vda
Nov 28 23:04:08 user nova-compute[74959]: DEBUG os_brick.utils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a375db-1d7a-4af4-88ff-cd1448649f58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c7cd6-0fc0-4a62-82c0-864438bbcdc1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[440ed1cc-7bdf-41dc-8f5b-8d9024a99af6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe2b13c-21ea-435a-9a77-78d6daadd0b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:08 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:04:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb7ce5d-2feb-4ca8-8b99-5f8dea414ec4]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG os_brick.utils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating existing volume attachment record: 349c0e90-5577-482e-8af8-d073e5fe44aa {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG nova.policy [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c27e0181a13a424e936577bcca742d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5b887638a24af38c1641516bfb376e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:04:09 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Creating image(s)
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Ensure instance console log exists: /opt/stack/data/nova/instances/e1174ec3-4ec5-4538-b304-60c76ec41bc8/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Start _get_guest_xml network_info=[{"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1174ec3-4ec5-4538-b304-60c76ec41bc8', 'attached_at': '', 'detached_at': '', 'volume_id': '858e5775-3686-4c19-b158-a2019e464c3f', 'serial': '858e5775-3686-4c19-b158-a2019e464c3f'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '4850f549-e846-4b0e-8b6e-fc0b06ac2ff6', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:04:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:09 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:09 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:09 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9042774c-ae13-49aa-a721-26fcfc72838c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:04:09 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4cec75-bc42-40a1-99a7-a69deec4ea71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f] added
Nov 28 23:04:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f65b5da-b288-457b-9d4f-30d12f908815]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a380b287-1c79-4a8d-9f2d-eda176a45feb]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eAzQlyCP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eAzQlyCP" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[69097186-f1b9-4240-a6e5-e83a64da36d9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eAzQlyCP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbcf1b-6097-40ff-bed0-f6215d5cc064]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfac313-6d8a-47f3-ae97-d17bf9e72862]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:04:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:04:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0a1008-3e57-40e8-89e9-2a348f91d6d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260]
Nov 28 23:04:09 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260] successful.
Nov 28 23:04:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[947e70dc-260a-46c7-be5a-fb23b6e264dc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e84e9a2-2747-4132-ba56-ddde18918b8f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:04:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:09 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:04:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a432a4-2524-4aac-9bf6-749bf2f6fdd8]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:04:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully created port: 5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26237386533626536', 'path': '/dev/sdg'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237386533626536', 'path': '/dev/sdg'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1082676943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1082676943',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqlpUARw/Tw9Nep95ScVmpCyPLJQOmSxAF1Y8ckwlsqtwT3jkaO4sDEsT0fDyaLML9r92WMny0erSsnO6MqU3oYNLrvO04b6VpEa5izHmhsvTDkh8uyrgG5eXNd00UpqQ==',key_name='tempest-keypair-1243684358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40c538561f8446748937abce99e7eddf',ramdisk_id='',reservation_id='r-psdni240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-95008496',owner_user_name='tempest-ServerActionsV293TestJSON-95008496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a20b8445a0a744588f59526545b4bc95',uuid=e1174ec3-4ec5-4538-b304-60c76ec41bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converting VIF {"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lazy-loading 'pci_devices' on Instance uuid e1174ec3-4ec5-4538-b304-60c76ec41bc8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:04:10 user nova-compute[74959]:   <uuid>e1174ec3-4ec5-4538-b304-60c76ec41bc8</uuid>
Nov 28 23:04:10 user nova-compute[74959]:   <name>instance-00000010</name>
Nov 28 23:04:10 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:04:10 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:04:10 user nova-compute[74959]:   <metadata>
Nov 28 23:04:10 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:04:10 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:04:10 user nova-compute[74959]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1082676943</nova:name>
Nov 28 23:04:10 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:04:09</nova:creationTime>
Nov 28 23:04:10 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:04:10 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:04:10 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:04:10 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:04:10 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:04:10 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:04:10 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:04:10 user nova-compute[74959]:       <nova:owner>
Nov 28 23:04:10 user nova-compute[74959]:         <nova:user uuid="a20b8445a0a744588f59526545b4bc95">tempest-ServerActionsV293TestJSON-95008496-project-member</nova:user>
Nov 28 23:04:10 user nova-compute[74959]:         <nova:project uuid="40c538561f8446748937abce99e7eddf">tempest-ServerActionsV293TestJSON-95008496</nova:project>
Nov 28 23:04:10 user nova-compute[74959]:       </nova:owner>
Nov 28 23:04:10 user nova-compute[74959]:       <nova:ports>
Nov 28 23:04:10 user nova-compute[74959]:         <nova:port uuid="5ced9d93-efc5-4031-8356-265e81b5884f">
Nov 28 23:04:10 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 23:04:10 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:10 user nova-compute[74959]:       </nova:ports>
Nov 28 23:04:10 user nova-compute[74959]:     </nova:instance>
Nov 28 23:04:10 user nova-compute[74959]:   </metadata>
Nov 28 23:04:10 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:04:10 user nova-compute[74959]:     <system>
Nov 28 23:04:10 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:04:10 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:04:10 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:04:10 user nova-compute[74959]:       <entry name="serial">e1174ec3-4ec5-4538-b304-60c76ec41bc8</entry>
Nov 28 23:04:10 user nova-compute[74959]:       <entry name="uuid">e1174ec3-4ec5-4538-b304-60c76ec41bc8</entry>
Nov 28 23:04:10 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:04:10 user nova-compute[74959]:     </system>
Nov 28 23:04:10 user nova-compute[74959]:   </sysinfo>
Nov 28 23:04:10 user nova-compute[74959]:   <os>
Nov 28 23:04:10 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:04:10 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:04:10 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:04:10 user nova-compute[74959]:   </os>
Nov 28 23:04:10 user nova-compute[74959]:   <features>
Nov 28 23:04:10 user nova-compute[74959]:     <acpi/>
Nov 28 23:04:10 user nova-compute[74959]:     <apic/>
Nov 28 23:04:10 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:04:10 user nova-compute[74959]:   </features>
Nov 28 23:04:10 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:04:10 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:04:10 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:04:10 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:04:10 user nova-compute[74959]:   </clock>
Nov 28 23:04:10 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:04:10 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:04:10 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:04:10 user nova-compute[74959]:   </cpu>
Nov 28 23:04:10 user nova-compute[74959]:   <devices>
Nov 28 23:04:10 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:04:10 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:10 user nova-compute[74959]:       <source dev="/dev/sdg"/>
Nov 28 23:04:10 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:04:10 user nova-compute[74959]:       <serial>858e5775-3686-4c19-b158-a2019e464c3f</serial>
Nov 28 23:04:10 user nova-compute[74959]:     </disk>
Nov 28 23:04:10 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:10 user nova-compute[74959]:       <mac address="fa:16:3e:e5:8a:f2"/>
Nov 28 23:04:10 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:10 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:10 user nova-compute[74959]:       <target dev="tap5ced9d93-ef"/>
Nov 28 23:04:10 user nova-compute[74959]:     </interface>
Nov 28 23:04:10 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:04:10 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/e1174ec3-4ec5-4538-b304-60c76ec41bc8/console.log" append="off"/>
Nov 28 23:04:10 user nova-compute[74959]:     </serial>
Nov 28 23:04:10 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:04:10 user nova-compute[74959]:     <video>
Nov 28 23:04:10 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:10 user nova-compute[74959]:     </video>
Nov 28 23:04:10 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:04:10 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:04:10 user nova-compute[74959]:     </rng>
Nov 28 23:04:10 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:04:10 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:04:10 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:04:10 user nova-compute[74959]:     </memballoon>
Nov 28 23:04:10 user nova-compute[74959]:   </devices>
Nov 28 23:04:10 user nova-compute[74959]: </domain>
Nov 28 23:04:10 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1082676943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1082676943',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqlpUARw/Tw9Nep95ScVmpCyPLJQOmSxAF1Y8ckwlsqtwT3jkaO4sDEsT0fDyaLML9r92WMny0erSsnO6MqU3oYNLrvO04b6VpEa5izHmhsvTDkh8uyrgG5eXNd00UpqQ==',key_name='tempest-keypair-1243684358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40c538561f8446748937abce99e7eddf',ramdisk_id='',reservation_id='r-psdni240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-95008496',owner_user_name='tempest-ServerActionsV293TestJSON-95008496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a20b8445a0a744588f59526545b4bc95',uuid=e1174ec3-4ec5-4538-b304-60c76ec41bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converting VIF {"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG os_vif [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0410e7e3-f93a-5a6d-b8bd-f35e0b570a55', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ced9d93-ef, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ced9d93-ef, col_values=(('qos', UUID('64272478-a30b-4638-b4f2-994ee5908845')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ced9d93-ef, col_values=(('external_ids', {'iface-id': '5ced9d93-efc5-4031-8356-265e81b5884f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:8a:f2', 'vm-uuid': 'e1174ec3-4ec5-4538-b304-60c76ec41bc8'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:10 user nova-compute[74959]: INFO os_vif [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef')
Nov 28 23:04:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:10 user nova-compute[74959]: INFO nova.compute.manager [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Terminating instance
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] No VIF found with MAC fa:16:3e:e5:8a:f2, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully created port: 50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:04:11 user nova-compute[74959]: INFO nova.compute.claims [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Claim successful on node user
Nov 28 23:04:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-73f9038a-0e85-475e-ad92-88b5421d1d7a req-fdd16af1-5488-42b5-b9c3-070f808c0f9e service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received event network-vif-unplugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-73f9038a-0e85-475e-ad92-88b5421d1d7a req-fdd16af1-5488-42b5-b9c3-070f808c0f9e service nova] Acquiring lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-73f9038a-0e85-475e-ad92-88b5421d1d7a req-fdd16af1-5488-42b5-b9c3-070f808c0f9e service nova] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-73f9038a-0e85-475e-ad92-88b5421d1d7a req-fdd16af1-5488-42b5-b9c3-070f808c0f9e service nova] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-73f9038a-0e85-475e-ad92-88b5421d1d7a req-fdd16af1-5488-42b5-b9c3-070f808c0f9e service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] No waiting events found dispatching network-vif-unplugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-73f9038a-0e85-475e-ad92-88b5421d1d7a req-fdd16af1-5488-42b5-b9c3-070f808c0f9e service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received event network-vif-unplugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:11 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe is timed out.
Nov 28 23:04:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully detached device vdb from instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe from the live domain config.
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEdzSqcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:11 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea69e624-34a3-4f4f-ab6b-d4a529855047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:04:11 user nova-compute[74959]: No targets found.
Nov 28 23:04:11 user nova-compute[74959]: iSNS:
Nov 28 23:04:11 user nova-compute[74959]: No targets found.
Nov 28 23:04:11 user nova-compute[74959]: STATIC:
Nov 28 23:04:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:04:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966
Nov 28 23:04:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:04:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:04:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f
Nov 28 23:04:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:04:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:11 user nova-compute[74959]: FIRMWARE:
Nov 28 23:04:11 user nova-compute[74959]: No targets found.
Nov 28 23:04:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:04:11 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:04:11 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf8bc74-0fce-4a34-ba64-cab18c8d7077]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbe9cff-62af-493a-9757-52c425892421]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:04:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:11 user nova-compute[74959]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f (non-flash)
Nov 28 23:04:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef44c0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f'): ({'sdf'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Removing single pathed devices sdf {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8196b7ea-3880-42d9-8927-5cc2e7039ea8]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.037s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2089d67a-fc53-4238-a824-29440799c1e1]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flushing IO for device /dev/sdf {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Instance destroyed successfully.
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.objects.instance [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lazy-loading 'resources' on Instance uuid 73fd8da6-d3c7-4401-a5cb-18365b030aa4 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce69d72e-c5ac-4730-8f59-d87ac39a33fc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1231430551',display_name='tempest-VolumesAdminNegativeTest-server-1231430551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1231430551',id=14,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29ef9d9fe9334bb19ddccc256847afcc',ramdisk_id='',reservation_id='r-3s1pf0ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1277404831',owner_user_name='tempest-VolumesAdminNegativeTest-1277404831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:02:20Z,user_data=None,user_id='b801c03a17a54b2dbb2d7d7e1a708126',uuid=73fd8da6-d3c7-4401-a5cb-18365b030aa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converting VIF {"id": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "address": "fa:16:3e:1a:61:87", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bd317b-69", "ovs_interfaceid": "23bd317b-6946-4ae5-91de-b685b8b8faf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:61:87,bridge_name='br-int',has_traffic_filtering=True,id=23bd317b-6946-4ae5-91de-b685b8b8faf4,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bd317b-69') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_vif [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:61:87,bridge_name='br-int',has_traffic_filtering=True,id=23bd317b-6946-4ae5-91de-b685b8b8faf4,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bd317b-69') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23bd317b-69, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.064s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de32444-e1be-4e38-a783-4d4710b44627]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ffde9fd-337e-4923-ad76-a45df190e9b9) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.787s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed094c-5352-4656-9ac0-08243623a4d0]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:12 user nova-compute[74959]: INFO os_vif [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:61:87,bridge_name='br-int',has_traffic_filtering=True,id=23bd317b-6946-4ae5-91de-b685b8b8faf4,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bd317b-69')
Nov 28 23:04:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Deleting instance files /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4_del
Nov 28 23:04:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Deletion of /opt/stack/data/nova/instances/73fd8da6-d3c7-4401-a5cb-18365b030aa4_del complete
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully created port: f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ea2e42-df05-4e78-816a-8ef261906678]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f, portal: 172.16.0.220,3260]
Nov 28 23:04:12 user nova-compute[74959]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f, portal: 172.16.0.220,3260] successful.
Nov 28 23:04:12 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:04:12 user nova-compute[74959]: INFO nova.compute.manager [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:04:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541c8fb-4ccf-4814-9d42-d778e411bf8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e4f270-4ebf-4efb-a3c6-a6c37498dc67]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== disconnect_volume: return (448ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:04:12 user nova-compute[74959]: INFO nova.compute.claims [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Claim successful on node user
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.policy [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a59fecc5b484491ca4f6b326d8bfcb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69f1c42c1314a41ac6a4ae41fb64c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:04:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Creating image(s)
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.214s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk 1073741824" returned: 0 in 0.069s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Successfully created port: 0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully created port: 8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.900s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.265s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:04:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.objects.instance [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Cannot resize image /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Ensure instance console log exists: /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-08845c03-c483-418e-9249-d4c3691b16de req-87066fbd-b47d-4295-aa9b-e0621933b579 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-08845c03-c483-418e-9249-d4c3691b16de req-87066fbd-b47d-4295-aa9b-e0621933b579 service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-08845c03-c483-418e-9249-d4c3691b16de req-87066fbd-b47d-4295-aa9b-e0621933b579 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-08845c03-c483-418e-9249-d4c3691b16de req-87066fbd-b47d-4295-aa9b-e0621933b579 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-08845c03-c483-418e-9249-d4c3691b16de req-87066fbd-b47d-4295-aa9b-e0621933b579 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] No waiting events found dispatching network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:13 user nova-compute[74959]: WARNING nova.compute.manager [req-08845c03-c483-418e-9249-d4c3691b16de req-87066fbd-b47d-4295-aa9b-e0621933b579 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received unexpected event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f for instance with vm_state building and task_state spawning.
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5e6b8781-a887-4e65-b3a0-93fb06b324f6 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.432s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.policy [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a59fecc5b484491ca4f6b326d8bfcb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69f1c42c1314a41ac6a4ae41fb64c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:04:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Creating image(s)
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:13 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Took 1.39 seconds to deallocate network for instance.
Nov 28 23:04:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-622a0eeb-077b-4002-b3d9-0b7201ab4f30 req-92876c0b-c82e-4af0-8a86-f038ae2f50b1 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received event network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-622a0eeb-077b-4002-b3d9-0b7201ab4f30 req-92876c0b-c82e-4af0-8a86-f038ae2f50b1 service nova] Acquiring lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-622a0eeb-077b-4002-b3d9-0b7201ab4f30 req-92876c0b-c82e-4af0-8a86-f038ae2f50b1 service nova] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-622a0eeb-077b-4002-b3d9-0b7201ab4f30 req-92876c0b-c82e-4af0-8a86-f038ae2f50b1 service nova] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-622a0eeb-077b-4002-b3d9-0b7201ab4f30 req-92876c0b-c82e-4af0-8a86-f038ae2f50b1 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] No waiting events found dispatching network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:13 user nova-compute[74959]: WARNING nova.compute.manager [req-622a0eeb-077b-4002-b3d9-0b7201ab4f30 req-92876c0b-c82e-4af0-8a86-f038ae2f50b1 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received unexpected event network-vif-plugged-23bd317b-6946-4ae5-91de-b685b8b8faf4 for instance with vm_state active and task_state deleting.
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.209s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully created port: c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk 1073741824" returned: 0 in 0.054s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Successfully updated port: 0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquired lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.702s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Cannot resize image /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Ensure instance console log exists: /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Successfully created port: cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:04:14 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Deleted allocations for instance 73fd8da6-d3c7-4401-a5cb-18365b030aa4
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully updated port: 5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-2cda084d-6651-466b-8e97-3e29761b5258 req-efe385e8-3b1c-472d-9e6d-96587bd3cc62 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-changed-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-2cda084d-6651-466b-8e97-3e29761b5258 req-efe385e8-3b1c-472d-9e6d-96587bd3cc62 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing instance network info cache due to event network-changed-5f0717ec-fb17-491c-9652-75a0a2634da9. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2cda084d-6651-466b-8e97-3e29761b5258 req-efe385e8-3b1c-472d-9e6d-96587bd3cc62 service nova] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2cda084d-6651-466b-8e97-3e29761b5258 req-efe385e8-3b1c-472d-9e6d-96587bd3cc62 service nova] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-2cda084d-6651-466b-8e97-3e29761b5258 req-efe385e8-3b1c-472d-9e6d-96587bd3cc62 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing network info cache for port 5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8510b4d9-71a9-4dcc-ae15-f258d19d49c4 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "73fd8da6-d3c7-4401-a5cb-18365b030aa4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.857s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-2cda084d-6651-466b-8e97-3e29761b5258 req-efe385e8-3b1c-472d-9e6d-96587bd3cc62 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updating instance_info_cache with network_info: [{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Releasing lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance network_info: |[{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Start _get_guest_xml network_info=[{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-2cda084d-6651-466b-8e97-3e29761b5258 req-efe385e8-3b1c-472d-9e6d-96587bd3cc62 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:14 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:14 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2cda084d-6651-466b-8e97-3e29761b5258 req-efe385e8-3b1c-472d-9e6d-96587bd3cc62 service nova] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1764014992',display_name='tempest-ServerRescueNegativeTestJSON-server-1764014992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1764014992',id=18,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-oh9l1yxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:12Z,user_data=None,user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=5d351a14-fe3f-4c98-833c-cdff15e5831b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:5f:d1,bridge_name='br-int',has_traffic_filtering=True,id=0ea3d331-73b7-4329-8f0a-83513c3c6b24,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3d331-73') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.objects.instance [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:04:14 user nova-compute[74959]:   <uuid>5d351a14-fe3f-4c98-833c-cdff15e5831b</uuid>
Nov 28 23:04:14 user nova-compute[74959]:   <name>instance-00000012</name>
Nov 28 23:04:14 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:04:14 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:04:14 user nova-compute[74959]:   <metadata>
Nov 28 23:04:14 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:04:14 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:04:14 user nova-compute[74959]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1764014992</nova:name>
Nov 28 23:04:14 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:04:14</nova:creationTime>
Nov 28 23:04:14 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:04:14 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:04:14 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:04:14 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:04:14 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:04:14 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:04:14 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:04:14 user nova-compute[74959]:       <nova:owner>
Nov 28 23:04:14 user nova-compute[74959]:         <nova:user uuid="a59fecc5b484491ca4f6b326d8bfcb67">tempest-ServerRescueNegativeTestJSON-1452838145-project-member</nova:user>
Nov 28 23:04:14 user nova-compute[74959]:         <nova:project uuid="d69f1c42c1314a41ac6a4ae41fb64c7c">tempest-ServerRescueNegativeTestJSON-1452838145</nova:project>
Nov 28 23:04:14 user nova-compute[74959]:       </nova:owner>
Nov 28 23:04:14 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:04:14 user nova-compute[74959]:       <nova:ports>
Nov 28 23:04:14 user nova-compute[74959]:         <nova:port uuid="0ea3d331-73b7-4329-8f0a-83513c3c6b24">
Nov 28 23:04:14 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 23:04:14 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:14 user nova-compute[74959]:       </nova:ports>
Nov 28 23:04:14 user nova-compute[74959]:     </nova:instance>
Nov 28 23:04:14 user nova-compute[74959]:   </metadata>
Nov 28 23:04:14 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:04:14 user nova-compute[74959]:     <system>
Nov 28 23:04:14 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:04:14 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:04:14 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:04:14 user nova-compute[74959]:       <entry name="serial">5d351a14-fe3f-4c98-833c-cdff15e5831b</entry>
Nov 28 23:04:14 user nova-compute[74959]:       <entry name="uuid">5d351a14-fe3f-4c98-833c-cdff15e5831b</entry>
Nov 28 23:04:14 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:04:14 user nova-compute[74959]:     </system>
Nov 28 23:04:14 user nova-compute[74959]:   </sysinfo>
Nov 28 23:04:14 user nova-compute[74959]:   <os>
Nov 28 23:04:14 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:04:14 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:04:14 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:04:14 user nova-compute[74959]:   </os>
Nov 28 23:04:14 user nova-compute[74959]:   <features>
Nov 28 23:04:14 user nova-compute[74959]:     <acpi/>
Nov 28 23:04:14 user nova-compute[74959]:     <apic/>
Nov 28 23:04:14 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:04:14 user nova-compute[74959]:   </features>
Nov 28 23:04:14 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:04:14 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:04:14 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:04:14 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:04:14 user nova-compute[74959]:   </clock>
Nov 28 23:04:14 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:04:14 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:04:14 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:04:14 user nova-compute[74959]:   </cpu>
Nov 28 23:04:14 user nova-compute[74959]:   <devices>
Nov 28 23:04:14 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:04:14 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:04:14 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk"/>
Nov 28 23:04:14 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:04:14 user nova-compute[74959]:     </disk>
Nov 28 23:04:14 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:14 user nova-compute[74959]:       <mac address="fa:16:3e:a7:5f:d1"/>
Nov 28 23:04:14 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:14 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:14 user nova-compute[74959]:       <target dev="tap0ea3d331-73"/>
Nov 28 23:04:14 user nova-compute[74959]:     </interface>
Nov 28 23:04:14 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:04:14 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/console.log" append="off"/>
Nov 28 23:04:14 user nova-compute[74959]:     </serial>
Nov 28 23:04:14 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:04:14 user nova-compute[74959]:     <video>
Nov 28 23:04:14 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:14 user nova-compute[74959]:     </video>
Nov 28 23:04:14 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:04:14 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:04:14 user nova-compute[74959]:     </rng>
Nov 28 23:04:14 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:04:14 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:04:14 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:04:14 user nova-compute[74959]:     </memballoon>
Nov 28 23:04:14 user nova-compute[74959]:   </devices>
Nov 28 23:04:14 user nova-compute[74959]: </domain>
Nov 28 23:04:14 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1764014992',display_name='tempest-ServerRescueNegativeTestJSON-server-1764014992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1764014992',id=18,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-oh9l1yxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:12Z,user_data=None,user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=5d351a14-fe3f-4c98-833c-cdff15e5831b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:5f:d1,bridge_name='br-int',has_traffic_filtering=True,id=0ea3d331-73b7-4329-8f0a-83513c3c6b24,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3d331-73') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG os_vif [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:5f:d1,bridge_name='br-int',has_traffic_filtering=True,id=0ea3d331-73b7-4329-8f0a-83513c3c6b24,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3d331-73') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4abefda-7d76-5c48-983c-18ec6255c2ab', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ea3d331-73, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ea3d331-73, col_values=(('qos', UUID('089561a0-6a01-4925-8831-648855834794')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ea3d331-73, col_values=(('external_ids', {'iface-id': '0ea3d331-73b7-4329-8f0a-83513c3c6b24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:5f:d1', 'vm-uuid': '5d351a14-fe3f-4c98-833c-cdff15e5831b'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:14 user nova-compute[74959]: INFO os_vif [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:5f:d1,bridge_name='br-int',has_traffic_filtering=True,id=0ea3d331-73b7-4329-8f0a-83513c3c6b24,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3d331-73')
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No VIF found with MAC fa:16:3e:a7:5f:d1, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:04:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance spawned successfully.
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:15 user nova-compute[74959]: INFO nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully updated port: f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:15 user nova-compute[74959]: INFO nova.compute.manager [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Took 15.86 seconds to build instance.
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-dbd53ee5-7cb7-4cab-b957-15ba45e06730 req-ef12f971-6a63-4085-9086-528673e68ac5 service nova] [instance: 73fd8da6-d3c7-4401-a5cb-18365b030aa4] Received event network-vif-deleted-23bd317b-6946-4ae5-91de-b685b8b8faf4 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-dbd53ee5-7cb7-4cab-b957-15ba45e06730 req-ef12f971-6a63-4085-9086-528673e68ac5 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-dbd53ee5-7cb7-4cab-b957-15ba45e06730 req-ef12f971-6a63-4085-9086-528673e68ac5 service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-dbd53ee5-7cb7-4cab-b957-15ba45e06730 req-ef12f971-6a63-4085-9086-528673e68ac5 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-dbd53ee5-7cb7-4cab-b957-15ba45e06730 req-ef12f971-6a63-4085-9086-528673e68ac5 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-dbd53ee5-7cb7-4cab-b957-15ba45e06730 req-ef12f971-6a63-4085-9086-528673e68ac5 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] No waiting events found dispatching network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:15 user nova-compute[74959]: WARNING nova.compute.manager [req-dbd53ee5-7cb7-4cab-b957-15ba45e06730 req-ef12f971-6a63-4085-9086-528673e68ac5 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received unexpected event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f for instance with vm_state active and task_state None.
Nov 28 23:04:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3679be79-cc21-4b58-bb0e-d6a9b36291c8 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.989s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Successfully updated port: cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquired lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-changed-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Refreshing instance network info cache due to event network-changed-0ea3d331-73b7-4329-8f0a-83513c3c6b24. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] Acquiring lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] Acquired lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.network.neutron [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Refreshing network info cache for port 0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updating instance_info_cache with network_info: [{"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Releasing lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Instance network_info: |[{"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Start _get_guest_xml network_info=[{"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:04:16 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:16 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-214754837',display_name='tempest-ServerRescueNegativeTestJSON-server-214754837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-214754837',id=19,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-nbpc56z6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:13Z,user_data=None,user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=82c0be4a-fbed-41e9-861b-c567fb67b696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:9e:90,bridge_name='br-int',has_traffic_filtering=True,id=cc72f2fc-0fc3-4aef-9d98-e2a77342845d,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc72f2fc-0f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'pci_devices' on Instance uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updated VIF entry in instance network info cache for port 0ea3d331-73b7-4329-8f0a-83513c3c6b24. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updating instance_info_cache with network_info: [{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:04:16 user nova-compute[74959]:   <uuid>82c0be4a-fbed-41e9-861b-c567fb67b696</uuid>
Nov 28 23:04:16 user nova-compute[74959]:   <name>instance-00000013</name>
Nov 28 23:04:16 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:04:16 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:04:16 user nova-compute[74959]:   <metadata>
Nov 28 23:04:16 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:04:16 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:04:16 user nova-compute[74959]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-214754837</nova:name>
Nov 28 23:04:16 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:04:16</nova:creationTime>
Nov 28 23:04:16 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:04:16 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:04:16 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:04:16 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:04:16 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:04:16 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:04:16 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:04:16 user nova-compute[74959]:       <nova:owner>
Nov 28 23:04:16 user nova-compute[74959]:         <nova:user uuid="a59fecc5b484491ca4f6b326d8bfcb67">tempest-ServerRescueNegativeTestJSON-1452838145-project-member</nova:user>
Nov 28 23:04:16 user nova-compute[74959]:         <nova:project uuid="d69f1c42c1314a41ac6a4ae41fb64c7c">tempest-ServerRescueNegativeTestJSON-1452838145</nova:project>
Nov 28 23:04:16 user nova-compute[74959]:       </nova:owner>
Nov 28 23:04:16 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:04:16 user nova-compute[74959]:       <nova:ports>
Nov 28 23:04:16 user nova-compute[74959]:         <nova:port uuid="cc72f2fc-0fc3-4aef-9d98-e2a77342845d">
Nov 28 23:04:16 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 23:04:16 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:16 user nova-compute[74959]:       </nova:ports>
Nov 28 23:04:16 user nova-compute[74959]:     </nova:instance>
Nov 28 23:04:16 user nova-compute[74959]:   </metadata>
Nov 28 23:04:16 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:04:16 user nova-compute[74959]:     <system>
Nov 28 23:04:16 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:04:16 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:04:16 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:04:16 user nova-compute[74959]:       <entry name="serial">82c0be4a-fbed-41e9-861b-c567fb67b696</entry>
Nov 28 23:04:16 user nova-compute[74959]:       <entry name="uuid">82c0be4a-fbed-41e9-861b-c567fb67b696</entry>
Nov 28 23:04:16 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:04:16 user nova-compute[74959]:     </system>
Nov 28 23:04:16 user nova-compute[74959]:   </sysinfo>
Nov 28 23:04:16 user nova-compute[74959]:   <os>
Nov 28 23:04:16 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:04:16 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:04:16 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:04:16 user nova-compute[74959]:   </os>
Nov 28 23:04:16 user nova-compute[74959]:   <features>
Nov 28 23:04:16 user nova-compute[74959]:     <acpi/>
Nov 28 23:04:16 user nova-compute[74959]:     <apic/>
Nov 28 23:04:16 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:04:16 user nova-compute[74959]:   </features>
Nov 28 23:04:16 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:04:16 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:04:16 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:04:16 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:04:16 user nova-compute[74959]:   </clock>
Nov 28 23:04:16 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:04:16 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:04:16 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:04:16 user nova-compute[74959]:   </cpu>
Nov 28 23:04:16 user nova-compute[74959]:   <devices>
Nov 28 23:04:16 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:04:16 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:04:16 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk"/>
Nov 28 23:04:16 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:04:16 user nova-compute[74959]:     </disk>
Nov 28 23:04:16 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:16 user nova-compute[74959]:       <mac address="fa:16:3e:bf:9e:90"/>
Nov 28 23:04:16 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:16 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:16 user nova-compute[74959]:       <target dev="tapcc72f2fc-0f"/>
Nov 28 23:04:16 user nova-compute[74959]:     </interface>
Nov 28 23:04:16 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:04:16 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/console.log" append="off"/>
Nov 28 23:04:16 user nova-compute[74959]:     </serial>
Nov 28 23:04:16 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:04:16 user nova-compute[74959]:     <video>
Nov 28 23:04:16 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:16 user nova-compute[74959]:     </video>
Nov 28 23:04:16 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:04:16 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:04:16 user nova-compute[74959]:     </rng>
Nov 28 23:04:16 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:04:16 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:04:16 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:04:16 user nova-compute[74959]:     </memballoon>
Nov 28 23:04:16 user nova-compute[74959]:   </devices>
Nov 28 23:04:16 user nova-compute[74959]: </domain>
Nov 28 23:04:16 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-214754837',display_name='tempest-ServerRescueNegativeTestJSON-server-214754837',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-214754837',id=19,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-nbpc56z6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:13Z,user_data=None,user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=82c0be4a-fbed-41e9-861b-c567fb67b696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:9e:90,bridge_name='br-int',has_traffic_filtering=True,id=cc72f2fc-0fc3-4aef-9d98-e2a77342845d,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc72f2fc-0f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG os_vif [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:9e:90,bridge_name='br-int',has_traffic_filtering=True,id=cc72f2fc-0fc3-4aef-9d98-e2a77342845d,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc72f2fc-0f') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c105b179-f06f-5376-a56b-46fea0e19c64', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] Releasing lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-changed-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Refreshing instance network info cache due to event network-changed-cc72f2fc-0fc3-4aef-9d98-e2a77342845d. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] Acquiring lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] Acquired lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Refreshing network info cache for port cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc72f2fc-0f, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc72f2fc-0f, col_values=(('qos', UUID('85e2e368-24f2-44d9-a71a-b9bf7e62c9e1')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc72f2fc-0f, col_values=(('external_ids', {'iface-id': 'cc72f2fc-0fc3-4aef-9d98-e2a77342845d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:9e:90', 'vm-uuid': '82c0be4a-fbed-41e9-861b-c567fb67b696'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully updated port: cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: INFO os_vif [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:9e:90,bridge_name='br-int',has_traffic_filtering=True,id=cc72f2fc-0fc3-4aef-9d98-e2a77342845d,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc72f2fc-0f')
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No VIF found with MAC fa:16:3e:bf:9e:90, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-changed-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing instance network info cache due to event network-changed-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing network info cache for port f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updated VIF entry in instance network info cache for port cc72f2fc-0fc3-4aef-9d98-e2a77342845d. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updating instance_info_cache with network_info: [{"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4656b761-6eca-403d-878f-ba9ebda730cd req-a92efbf0-e7f8-4be9-a0d3-b7f91342bf29 service nova] Releasing lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.network.neutron [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-changed-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing instance network info cache due to event network-changed-cea6f662-54ce-411f-98ba-d7c05acf8f59. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.network.neutron [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing network info cache for port cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully updated port: 50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.network.neutron [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-bc2b926a-e82e-4d67-92f1-f54bbd04139d req-85f5701c-c874-43a4-9344-0b2774921548 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bc2b926a-e82e-4d67-92f1-f54bbd04139d req-85f5701c-c874-43a4-9344-0b2774921548 service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bc2b926a-e82e-4d67-92f1-f54bbd04139d req-85f5701c-c874-43a4-9344-0b2774921548 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bc2b926a-e82e-4d67-92f1-f54bbd04139d req-85f5701c-c874-43a4-9344-0b2774921548 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-bc2b926a-e82e-4d67-92f1-f54bbd04139d req-85f5701c-c874-43a4-9344-0b2774921548 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:17 user nova-compute[74959]: WARNING nova.compute.manager [req-bc2b926a-e82e-4d67-92f1-f54bbd04139d req-85f5701c-c874-43a4-9344-0b2774921548 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state building and task_state spawning.
Nov 28 23:04:17 user nova-compute[74959]: INFO nova.virt.block_device [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Booting with volume 0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 at /dev/vdb
Nov 28 23:04:17 user nova-compute[74959]: DEBUG nova.network.neutron [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG os_brick.utils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-14f7b674-4eec-4e02-95b1-83e1b475d706 req-11c715f2-5157-4105-ba39-9ea904c01f35 service nova] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[df81039e-2682-4b9f-b1f1-cdc028a3b20d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9950298-10a3-47cd-9a1b-994f51ad7d66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e8fb6-7973-42ec-b3ce-20357d6c2f41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad12bd-4351-4ff5-9df4-9ad64265c1b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:18 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa550ea5-c9ae-4907-8c3a-ffaaaa0bde52]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG os_brick.utils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating existing volume attachment record: ff4745cc-8594-46b3-bbfa-bdf7e13616d1 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully updated port: f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-changed-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing instance network info cache due to event network-changed-50068be6-b4d5-4089-a0c6-a0b8b9ef7044. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing network info cache for port 50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.network.neutron [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-changed-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing instance network info cache due to event network-changed-f893a0fc-a870-456c-bbf9-f00fd80130f5. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.network.neutron [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing network info cache for port f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully updated port: 8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.network.neutron [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.network.neutron [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-608a892f-e497-4d61-a715-4c7ae9dcae6d req-0ca9b644-6ecc-4a41-9877-fdadeef91121 service nova] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:19 user nova-compute[74959]: WARNING nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state building and task_state spawning.
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] No waiting events found dispatching network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:19 user nova-compute[74959]: WARNING nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received unexpected event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d for instance with vm_state building and task_state spawning.
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] No waiting events found dispatching network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:19 user nova-compute[74959]: WARNING nova.compute.manager [req-80d2e84a-dbd3-4995-a715-39f30bec6454 req-90922188-ba0a-4e74-b35e-82e23370e279 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received unexpected event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d for instance with vm_state building and task_state spawning.
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Successfully updated port: c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:04:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance spawned successfully.
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:20 user nova-compute[74959]: INFO nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Took 8.48 seconds to spawn the instance on the hypervisor.
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-changed-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing instance network info cache due to event network-changed-8ea41a22-a65d-41ab-8658-fe14d9386822. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:20 user nova-compute[74959]: INFO nova.compute.manager [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Took 9.72 seconds to build instance.
Nov 28 23:04:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-17c7d539-0950-4d4f-acfa-c15125be69a0 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.860s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:04:21 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Instance spawned successfully.
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:21 user nova-compute[74959]: INFO nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Took 7.91 seconds to spawn the instance on the hypervisor.
Nov 28 23:04:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:04:21 user nova-compute[74959]: INFO nova.compute.manager [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Took 9.41 seconds to build instance.
Nov 28 23:04:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b395e8b0-124b-476e-af36-656d468f6480 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.546s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance network_info: |[{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:04:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:22 user nova-compute[74959]: DEBUG nova.network.neutron [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing network info cache for port 8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:23 user nova-compute[74959]: INFO nova.compute.manager [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Rescuing
Nov 28 23:04:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquired lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG nova.network.neutron [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updated VIF entry in instance network info cache for port 8ea41a22-a65d-41ab-8658-fe14d9386822. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-changed-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing instance network info cache due to event network-changed-c16bdc9c-2454-43b3-b4c4-2f28ab154894. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing network info cache for port c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG nova.network.neutron [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating instance_info_cache with network_info: [{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG nova.network.neutron [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updated VIF entry in instance network info cache for port c16bdc9c-2454-43b3-b4c4-2f28ab154894. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG nova.network.neutron [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Releasing lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-11915549-310d-42c1-971f-7dd9e1f3b23c req-ed7f2349-6a35-4897-afb9-625284f31392 service nova] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-5fcc719c-db42-45f3-a556-384978bf9303 req-536c8d6d-c1bd-4708-97e9-dc9277c1c221 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5fcc719c-db42-45f3-a556-384978bf9303 req-536c8d6d-c1bd-4708-97e9-dc9277c1c221 service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5fcc719c-db42-45f3-a556-384978bf9303 req-536c8d6d-c1bd-4708-97e9-dc9277c1c221 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5fcc719c-db42-45f3-a556-384978bf9303 req-536c8d6d-c1bd-4708-97e9-dc9277c1c221 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-5fcc719c-db42-45f3-a556-384978bf9303 req-536c8d6d-c1bd-4708-97e9-dc9277c1c221 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:24 user nova-compute[74959]: WARNING nova.compute.manager [req-5fcc719c-db42-45f3-a556-384978bf9303 req-536c8d6d-c1bd-4708-97e9-dc9277c1c221 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state active and task_state rescuing.
Nov 28 23:04:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance destroyed successfully.
Nov 28 23:04:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Attempting a stable device rescue
Nov 28 23:04:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74959) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 23:04:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance directory exists: not creating {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 23:04:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Creating image(s)
Nov 28 23:04:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "/opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "/opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "/opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:25 user nova-compute[74959]: DEBUG nova.objects.instance [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'trusted_certs' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "ebd0148316df90f2325aa0481867ae93a5489308" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "ebd0148316df90f2325aa0481867ae93a5489308" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-341c0eb0-65fb-4d0b-8ef8-2e136712f1a5 req-6fe7d9b3-2b25-4fae-aa9c-44dccac2f40b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-341c0eb0-65fb-4d0b-8ef8-2e136712f1a5 req-6fe7d9b3-2b25-4fae-aa9c-44dccac2f40b service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-341c0eb0-65fb-4d0b-8ef8-2e136712f1a5 req-6fe7d9b3-2b25-4fae-aa9c-44dccac2f40b service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-341c0eb0-65fb-4d0b-8ef8-2e136712f1a5 req-6fe7d9b3-2b25-4fae-aa9c-44dccac2f40b service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-341c0eb0-65fb-4d0b-8ef8-2e136712f1a5 req-6fe7d9b3-2b25-4fae-aa9c-44dccac2f40b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:27 user nova-compute[74959]: WARNING nova.compute.manager [req-341c0eb0-65fb-4d0b-8ef8-2e136712f1a5 req-6fe7d9b3-2b25-4fae-aa9c-44dccac2f40b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state active and task_state rescuing.
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308.part --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG nova.virt.images [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] 8bf7747f-a1ff-4ebe-9d7b-64e5391a6776 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308.part /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308.part /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308.converted" returned: 0 in 0.397s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: INFO nova.virt.block_device [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Booting with volume a01a0d16-1ac9-4fd7-88bd-250245abdeb6 at /dev/vdc
Nov 28 23:04:27 user nova-compute[74959]: DEBUG os_brick.utils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efea95f-bb4a-4f58-9e33-a106533882f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d618bd2c-8e25-4c5e-9135-7242ce9b4ee5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6824c468-e23a-4853-96d2-6e14542db518]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6335d5b-6da1-4cb1-8b37-8ce80a10097d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308.converted --force-share --output=json" returned: 0 in 0.285s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "ebd0148316df90f2325aa0481867ae93a5489308" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.813s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "ebd0148316df90f2325aa0481867ae93a5489308" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "ebd0148316df90f2325aa0481867ae93a5489308" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:27 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:04:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c4acdf-ae26-43da-bb9d-2dad59bc3e8b]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG os_brick.utils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:27 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating existing volume attachment record: 9d5d37a3-859e-4778-bac3-582dc4ffd7aa {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:28 user nova-compute[74959]: INFO nova.compute.manager [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Detaching volume 18f67820-210f-46b7-8bf3-4b786b77b966
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308 --force-share --output=json" returned: 0 in 0.236s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308,backing_fmt=raw /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308,backing_fmt=raw /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue" returned: 0 in 0.068s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "ebd0148316df90f2325aa0481867ae93a5489308" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'migration_context' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<e245a015-fc98-4557-8168-5089c3746e79> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Start _get_guest_xml network_info=[{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "vif_mac": "fa:16:3e:65:99:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bf7747f-a1ff-4ebe-9d7b-64e5391a6776', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agoWCfzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e245a015-fc98-4557-8168-5089c3746e79', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'serial': 'c4d040aa-729e-4f9c-bfe6-2ac14c0fa106'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '56b21725-5287-4410-8387-62ba6d7f715c', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'resources' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<e245a015-fc98-4557-8168-5089c3746e79> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'numa_topology' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<e245a015-fc98-4557-8168-5089c3746e79> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:04:28 user nova-compute[74959]: INFO nova.virt.block_device [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Attempting to driver detach volume 18f67820-210f-46b7-8bf3-4b786b77b966 from mountpoint /dev/vdc
Nov 28 23:04:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Attempting to detach device vdc from instance 94b085b2-b298-4780-be94-21f85c799945 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:04:28 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:28 user nova-compute[74959]:   <source dev="/dev/sdd"/>
Nov 28 23:04:28 user nova-compute[74959]:   <target dev="vdc" bus="virtio"/>
Nov 28 23:04:28 user nova-compute[74959]:   <serial>18f67820-210f-46b7-8bf3-4b786b77b966</serial>
Nov 28 23:04:28 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 23:04:28 user nova-compute[74959]: </disk>
Nov 28 23:04:28 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'vcpu_model' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:28 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully detached device vdc from instance 94b085b2-b298-4780-be94-21f85c799945 from the persistent domain config.
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 94b085b2-b298-4780-be94-21f85c799945 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:04:28 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:28 user nova-compute[74959]:   <source dev="/dev/sdd"/>
Nov 28 23:04:28 user nova-compute[74959]:   <target dev="vdc" bus="virtio"/>
Nov 28 23:04:28 user nova-compute[74959]:   <serial>18f67820-210f-46b7-8bf3-4b786b77b966</serial>
Nov 28 23:04:28 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 23:04:28 user nova-compute[74959]: </disk>
Nov 28 23:04:28 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<e245a015-fc98-4557-8168-5089c3746e79> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agoWCfzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:28 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:28 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:28 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca81dad-8520-4e34-a3a3-351aa578aa2d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = agoWCfzU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 23:04:28 user nova-compute[74959]: node.name = iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:04:28 user nova-compute[74959]: node.tpgt = -1
Nov 28 23:04:28 user nova-compute[74959]: node.startup = automatic
Nov 28 23:04:28 user nova-compute[74959]: node.leading_login = No
Nov 28 23:04:28 user nova-compute[74959]: iface.iscsi_ifacename = default
Nov 28 23:04:28 user nova-compute[74959]: iface.net_ifacename = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.ipaddress = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.prefix_len = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.hwaddress = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.transport_name = tcp
Nov 28 23:04:28 user nova-compute[74959]: iface.initiatorname = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.state = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.vlan_id = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.vlan_priority = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.vlan_state = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.iface_num = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.mtu = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.port = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.bootproto = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.subnet_mask = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.gateway = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.dhcp_alt_client_id = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.dhcp_dns = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.dhcp_learn_iqn = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.dhcp_vendor_id_state = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.dhcp_vendor_id = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.dhcp_slp_da = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.fragmentation = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.gratuitous_arp = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.incoming_forwarding = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.tos_state = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.tos = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.ttl = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.delayed_ack = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.tcp_nagle = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.tcp_wsf_state = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.tcp_wsf = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.tcp_timer_scale = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.tcp_timestamp = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.redirect = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.def_task_mgmt_timeout = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.header_digest = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.data_digest = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.immediate_data = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.initial_r2t = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.data_seq_inorder = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.data_pdu_inorder = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.erl = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.max_receive_data_len = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.first_burst_len = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.max_outstanding_r2t = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.max_burst_len = 0
Nov 28 23:04:28 user nova-compute[74959]: iface.chap_auth = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.bidi_chap = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.strict_login_compliance = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.discovery_auth = <empty>
Nov 28 23:04:28 user nova-compute[74959]: iface.discovery_logout = <empty>
Nov 28 23:04:28 user nova-compute[74959]: node.discovery_address = <empty>
Nov 28 23:04:28 user nova-compute[74959]: node.discovery_port = 0
Nov 28 23:04:28 user nova-compute[74959]: node.discovery_type = static
Nov 28 23:04:28 user nova-compute[74959]: node.session.initial_cmdsn = 0
Nov 28 23:04:28 user nova-compute[74959]: node.session.initial_login_retry_max = 8
Nov 28 23:04:28 user nova-compute[74959]: node.session.xmit_thread_priority = -20
Nov 28 23:04:28 user nova-compute[74959]: node.session.cmds_max = 128
Nov 28 23:04:28 user nova-compute[74959]: node.session.queue_depth = 32
Nov 28 23:04:28 user nova-compute[74959]: node.session.nr_sessions = 1
Nov 28 23:04:28 user nova-compute[74959]: node.session.auth.authmethod = CHAP
Nov 28 23:04:28 user nova-compute[74959]: node.session.auth.username = agoWCfzU
Nov 28 23:04:28 user nova-compute[74959]: node.session.auth.password = ***
Nov 28 23:04:28 user nova-compute[74959]: node.session.auth.username_in = <empty>
Nov 28 23:04:28 user nova-compute[74959]: node.session.auth.password_in = <empty>
Nov 28 23:04:28 user nova-compute[74959]: node.session.auth.chap_algs = MD5
Nov 28 23:04:28 user nova-compute[74959]: node.session.timeo.replacement_timeout = 120
Nov 28 23:04:28 user nova-compute[74959]: node.session.err_timeo.abort_timeout = 15
Nov 28 23:04:28 user nova-compute[74959]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 23:04:28 user nova-compute[74959]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 23:04:28 user nova-compute[74959]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.FastAbort = Yes
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.InitialR2T = No
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.ImmediateData = Yes
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.MaxConnections = 1
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 23:04:28 user nova-compute[74959]: node.session.iscsi.ERL = 0
Nov 28 23:04:28 user nova-compute[74959]: node.session.scan = manual
Nov 28 23:04:28 user nova-compute[74959]: node.session.reopen_max = 0
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].address = 172.16.0.220
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].port = 3260
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].startup = manual
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].tcp.window_size = 524288
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].tcp.type_of_service = 0
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].timeo.logout_timeout = 15
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].timeo.login_timeout = 15
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].timeo.auth_timeout = 45
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].iscsi.DataDigest = None
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].iscsi.IFMarker = No
Nov 28 23:04:28 user nova-compute[74959]: node.conn[0].iscsi.OFMarker = No
Nov 28 23:04:28 user nova-compute[74959]: # END RECORD
Nov 28 23:04:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d665c90e-abab-49ee-8cd7-b69487b3975b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1cd1e3-56fb-4e13-8ce5-c958b689628a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agoWCfzU {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agoWCfzU" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec229162-daf8-466f-b65f-fe9509971383]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'agoWCfzU'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3540983e-56aa-4c55-b4e2-53fb2bf8a5cc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e9f00d-0637-46ab-bd5f-e354a5d7dff9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:28 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:28 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:28 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:28 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:28 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:28 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:28 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:28 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb7ff71-19d9-4fd0-92d6-a6250cc7821b]: (4, ('0 0 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agoWCfzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.221s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] <== connect_volume: return (223ms) {'type': 'block', 'scsi_wwn': '23134393532346432', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134393532346432', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1486772722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1486772722',id=15,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:02:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-vnxjucqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:02:53Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=e245a015-fc98-4557-8168-5089c3746e79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "vif_mac": "fa:16:3e:65:99:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "vif_mac": "fa:16:3e:65:99:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:99:34,bridge_name='br-int',has_traffic_filtering=True,id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7515dc9f-ea') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'pci_devices' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.objects.base [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<e245a015-fc98-4557-8168-5089c3746e79> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:04:28 user nova-compute[74959]:   <uuid>e245a015-fc98-4557-8168-5089c3746e79</uuid>
Nov 28 23:04:28 user nova-compute[74959]:   <name>instance-0000000f</name>
Nov 28 23:04:28 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:04:28 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:04:28 user nova-compute[74959]:   <metadata>
Nov 28 23:04:28 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:04:28 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:04:28 user nova-compute[74959]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1486772722</nova:name>
Nov 28 23:04:28 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:04:28</nova:creationTime>
Nov 28 23:04:28 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:04:28 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:04:28 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:04:28 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:04:28 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:04:28 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:04:28 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:04:28 user nova-compute[74959]:       <nova:owner>
Nov 28 23:04:28 user nova-compute[74959]:         <nova:user uuid="5a8d218abbe14f27b754f1fffd9553f8">tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member</nova:user>
Nov 28 23:04:28 user nova-compute[74959]:         <nova:project uuid="8da22f0050e34c9b9a7658f16c08f28b">tempest-ServerBootFromVolumeStableRescueTest-1156029205</nova:project>
Nov 28 23:04:28 user nova-compute[74959]:       </nova:owner>
Nov 28 23:04:28 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:04:28 user nova-compute[74959]:       <nova:ports>
Nov 28 23:04:28 user nova-compute[74959]:         <nova:port uuid="7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0">
Nov 28 23:04:28 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:04:28 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:28 user nova-compute[74959]:       </nova:ports>
Nov 28 23:04:28 user nova-compute[74959]:     </nova:instance>
Nov 28 23:04:28 user nova-compute[74959]:   </metadata>
Nov 28 23:04:28 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:04:28 user nova-compute[74959]:     <system>
Nov 28 23:04:28 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:04:28 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:04:28 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:04:28 user nova-compute[74959]:       <entry name="serial">e245a015-fc98-4557-8168-5089c3746e79</entry>
Nov 28 23:04:28 user nova-compute[74959]:       <entry name="uuid">e245a015-fc98-4557-8168-5089c3746e79</entry>
Nov 28 23:04:28 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:04:28 user nova-compute[74959]:     </system>
Nov 28 23:04:28 user nova-compute[74959]:   </sysinfo>
Nov 28 23:04:28 user nova-compute[74959]:   <os>
Nov 28 23:04:28 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:04:28 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:04:28 user nova-compute[74959]:   </os>
Nov 28 23:04:28 user nova-compute[74959]:   <features>
Nov 28 23:04:28 user nova-compute[74959]:     <acpi/>
Nov 28 23:04:28 user nova-compute[74959]:     <apic/>
Nov 28 23:04:28 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:04:28 user nova-compute[74959]:   </features>
Nov 28 23:04:28 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:04:28 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:04:28 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:04:28 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:04:28 user nova-compute[74959]:   </clock>
Nov 28 23:04:28 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:04:28 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:04:28 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:04:28 user nova-compute[74959]:   </cpu>
Nov 28 23:04:28 user nova-compute[74959]:   <devices>
Nov 28 23:04:28 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:04:28 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:28 user nova-compute[74959]:       <source dev="/dev/sdc"/>
Nov 28 23:04:28 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:04:28 user nova-compute[74959]:       <serial>c4d040aa-729e-4f9c-bfe6-2ac14c0fa106</serial>
Nov 28 23:04:28 user nova-compute[74959]:     </disk>
Nov 28 23:04:28 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:04:28 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:04:28 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue"/>
Nov 28 23:04:28 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:04:28 user nova-compute[74959]:       <boot order="1"/>
Nov 28 23:04:28 user nova-compute[74959]:     </disk>
Nov 28 23:04:28 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:28 user nova-compute[74959]:       <mac address="fa:16:3e:65:99:34"/>
Nov 28 23:04:28 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:28 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:28 user nova-compute[74959]:       <target dev="tap7515dc9f-ea"/>
Nov 28 23:04:28 user nova-compute[74959]:     </interface>
Nov 28 23:04:28 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:04:28 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/console.log" append="off"/>
Nov 28 23:04:28 user nova-compute[74959]:     </serial>
Nov 28 23:04:28 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:04:28 user nova-compute[74959]:     <video>
Nov 28 23:04:28 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:28 user nova-compute[74959]:     </video>
Nov 28 23:04:28 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:04:28 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:04:28 user nova-compute[74959]:     </rng>
Nov 28 23:04:28 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:04:28 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:04:28 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:04:28 user nova-compute[74959]:     </memballoon>
Nov 28 23:04:28 user nova-compute[74959]:   </devices>
Nov 28 23:04:28 user nova-compute[74959]: </domain>
Nov 28 23:04:28 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:04:28 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance destroyed successfully.
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:04:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No VIF found with MAC fa:16:3e:65:99:34, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:04:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-8580e1dc-c3fd-40e3-8ba3-2a180ac17c01 req-9fcf14e5-b622-46b2-afa9-55f0f3dccc27 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8580e1dc-c3fd-40e3-8ba3-2a180ac17c01 req-9fcf14e5-b622-46b2-afa9-55f0f3dccc27 service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8580e1dc-c3fd-40e3-8ba3-2a180ac17c01 req-9fcf14e5-b622-46b2-afa9-55f0f3dccc27 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8580e1dc-c3fd-40e3-8ba3-2a180ac17c01 req-9fcf14e5-b622-46b2-afa9-55f0f3dccc27 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-8580e1dc-c3fd-40e3-8ba3-2a180ac17c01 req-9fcf14e5-b622-46b2-afa9-55f0f3dccc27 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:30 user nova-compute[74959]: WARNING nova.compute.manager [req-8580e1dc-c3fd-40e3-8ba3-2a180ac17c01 req-9fcf14e5-b622-46b2-afa9-55f0f3dccc27 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state active and task_state rescuing.
Nov 28 23:04:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-ab6d4091-274e-483d-baeb-7077647f7a2c req-e446b1e9-3518-4b06-ad5e-3374e0ea4f9b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ab6d4091-274e-483d-baeb-7077647f7a2c req-e446b1e9-3518-4b06-ad5e-3374e0ea4f9b service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ab6d4091-274e-483d-baeb-7077647f7a2c req-e446b1e9-3518-4b06-ad5e-3374e0ea4f9b service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ab6d4091-274e-483d-baeb-7077647f7a2c req-e446b1e9-3518-4b06-ad5e-3374e0ea4f9b service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-ab6d4091-274e-483d-baeb-7077647f7a2c req-e446b1e9-3518-4b06-ad5e-3374e0ea4f9b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:32 user nova-compute[74959]: WARNING nova.compute.manager [req-ab6d4091-274e-483d-baeb-7077647f7a2c req-e446b1e9-3518-4b06-ad5e-3374e0ea4f9b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state active and task_state rescuing.
Nov 28 23:04:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-efccaf02-e8a3-4240-a964-b70b35bdfb25 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:04:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:04:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:34 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:04:35 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:04:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:04:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Creating image(s)
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Ensure instance console log exists: /opt/stack/data/nova/instances/b3e1c6ff-87c8-48e7-8f05-693d26138bf5/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Start _get_guest_xml network_info=[{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLpFoJzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5', 'attached_at': '', 'detached_at': '', 'volume_id': '4c60692e-a677-4060-a1b8-b1a2c27068fa', 'serial': '4c60692e-a677-4060-a1b8-b1a2c27068fa'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '349c0e90-5577-482e-8af8-d073e5fe44aa', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBTWoYFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5', 'attached_at': '', 'detached_at': '', 'volume_id': '0faed3ce-1cd1-4bdd-9d34-176e4aa510b9', 'serial': '0faed3ce-1cd1-4bdd-9d34-176e4aa510b9'}, 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': 'ff4745cc-8594-46b3-bbfa-bdf7e13616d1', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJOIHtDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5', 'attached_at': '', 'detached_at': '', 'volume_id': 'a01a0d16-1ac9-4fd7-88bd-250245abdeb6', 'serial': 'a01a0d16-1ac9-4fd7-88bd-250245abdeb6'}, 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': '9d5d37a3-859e-4778-bac3-582dc4ffd7aa', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:04:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLpFoJzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:37 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:37 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:37 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:04:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260" returned: 21 in 0.060s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d38636d-85e1-442e-beda-f34780225d1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:04:38 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847a927-12d5-4329-b763-d8bf7aac57a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa] added
Nov 28 23:04:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.231s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dab6b8-ba11-47db-a50f-812da915f61d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a7a17d-4094-4245-8d9b-f79c71094ecb]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLpFoJzm {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLpFoJzm" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea1b65d-be75-4803-8a8b-28f28efc9221]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RLpFoJzm'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.062s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fdf3c4-99bc-4b0d-9214-3db47bc9286e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4711a5b4-2745-4bc4-99f0-d382e36596dc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dcd7ed-db6c-45a0-9e45-97cf654d916a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa, portal: 172.16.0.220,3260]
Nov 28 23:04:38 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa, portal: 172.16.0.220,3260] successful.
Nov 28 23:04:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d2f02f-8f31-499c-bcaa-84c519849b56]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f52ba1-53e3-41af-b98c-f78267d8168a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:38 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.793s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f19d0e-6dce-4b52-aa9c-cbfc44d1a046]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLpFoJzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:04:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG nova.network.neutron [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Port 67663953-c88b-4b51-88e5-2904a213a0ef binding to destination host user is already ACTIVE {{(pid=74959) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquired lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG nova.network.neutron [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.432s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG nova.network.neutron [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.862s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== connect_volume: return (1863ms) {'type': 'block', 'scsi_wwn': '23539376630656561', 'path': '/dev/sdf'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539376630656561', 'path': '/dev/sdf'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Releasing lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Creating tmpfile /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/tmpz_5vsm_2 to verify with other compute node that the instance is on the same shared storage. {{(pid=74959) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBTWoYFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:39 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:39 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:39 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1b6a99-cdec-421f-b2d3-b9230c0636d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:04:39 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea1a3d3-0218-4d88-93ce-75518f1163da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9] added
Nov 28 23:04:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[82059e31-0e3c-45c9-8d5f-df6862ebb327]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1da3a4-0024-43cf-a24c-af35beb310ab]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBTWoYFK {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBTWoYFK" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d2f0e7-ab3a-46f1-8a7e-aa924d66e217]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gBTWoYFK'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b43a66-242e-4942-989b-f08a50eea839]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9e3ec9-d9f7-46d1-8efb-8da906f9e691]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[205d56ea-5836-4699-9a3a-fed46619b065]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9, portal: 172.16.0.220,3260]
Nov 28 23:04:40 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9, portal: 172.16.0.220,3260] successful.
Nov 28 23:04:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-601e3c55-b3df-40c5-b4a2-aab8400d10be req-4539991d-cc63-405e-b119-31c4f82eb041 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-601e3c55-b3df-40c5-b4a2-aab8400d10be req-4539991d-cc63-405e-b119-31c4f82eb041 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-601e3c55-b3df-40c5-b4a2-aab8400d10be req-4539991d-cc63-405e-b119-31c4f82eb041 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-601e3c55-b3df-40c5-b4a2-aab8400d10be req-4539991d-cc63-405e-b119-31c4f82eb041 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-601e3c55-b3df-40c5-b4a2-aab8400d10be req-4539991d-cc63-405e-b119-31c4f82eb041 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:40 user nova-compute[74959]: WARNING nova.compute.manager [req-601e3c55-b3df-40c5-b4a2-aab8400d10be req-4539991d-cc63-405e-b119-31c4f82eb041 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state resized and task_state resize_reverting.
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[569cdd6e-c53f-4b0a-9130-5d68c9c0213f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d865aeae-1a9f-4cbf-b9fa-a2f196d1e93f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:40 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.573s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd488758-e7ca-4f40-bf52-b44e8580c3f9]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBTWoYFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:40 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance destroyed successfully.
Nov 28 23:04:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.objects.instance [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lazy-loading 'resources' on Instance uuid 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:03:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_vif [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67663953-c8, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbfc5c8a-946f-4909-9879-415c4c52d3c2) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:40 user nova-compute[74959]: INFO os_vif [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8')
Nov 28 23:04:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:40 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:41 user nova-compute[74959]: INFO nova.compute.manager [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Terminating instance
Nov 28 23:04:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.634s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== connect_volume: return (1637ms) {'type': 'block', 'scsi_wwn': '23836643930656266', 'path': '/dev/sdh'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836643930656266', 'path': '/dev/sdh'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.549s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc0167-6a76-4aa1-8ca6-cfafbcf9c249]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJOIHtDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:41 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:04:41 user nova-compute[74959]: No targets found.
Nov 28 23:04:41 user nova-compute[74959]: iSNS:
Nov 28 23:04:41 user nova-compute[74959]: No targets found.
Nov 28 23:04:41 user nova-compute[74959]: STATIC:
Nov 28 23:04:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:04:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966
Nov 28 23:04:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:04:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:04:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa
Nov 28 23:04:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9
Nov 28 23:04:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:41 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:04:41 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:41 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:41 user nova-compute[74959]: FIRMWARE:
Nov 28 23:04:41 user nova-compute[74959]: No targets found.
Nov 28 23:04:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:04:41 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:04:41 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue --force-share --output=json" returned: 0 in 0.299s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fdd375-2601-4a89-b267-756c84f921e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.077s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba059c37-1935-47d8-a810-c5f699250571]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:41 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:41 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc762830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2'): ({'sde'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Removing single pathed devices sde {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ea4836-6534-49d2-ba51-adf4559c3387]: (4, ('path checker states:\nup                  5\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[88955a5a-917d-4282-9240-cd070ec8f95d]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flushing IO for device /dev/sde {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafeabc3-42b5-4cf2-bf41-22e9b393e61e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:04:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.107s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b85fdc2-b4b0-45c1-8c9a-ee6e08b3c188]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d6a303-2585-43df-9040-908b0ce61c6c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ed32b-1118-4bc9-8281-0ec04b840ca1]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]
Nov 28 23:04:42 user nova-compute[74959]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.
Nov 28 23:04:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e64748-8ded-4367-b73c-b84ffb51d294]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.773s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== disconnect_volume: return (1322ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.688s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:42 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:42 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8322dade-144c-4cc6-b53c-c13c1e3702e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:04:42 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2601257-e121-45b2-99e6-5ab4b49d8bce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6] added
Nov 28 23:04:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990a4c9-9dbb-4bbe-8941-a6a40dbb86f8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:42 user nova-compute[74959]: WARNING nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state resized and task_state resize_reverting.
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:42 user nova-compute[74959]: WARNING nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state resized and task_state resize_reverting.
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:42 user nova-compute[74959]: WARNING nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state resized and task_state resize_reverting.
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:42 user nova-compute[74959]: WARNING nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state resized and task_state resize_reverting.
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:42 user nova-compute[74959]: WARNING nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state resized and task_state resize_reverting.
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received event network-vif-unplugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] No waiting events found dispatching network-vif-unplugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received event network-vif-unplugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received event network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Acquiring lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] No waiting events found dispatching network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:42 user nova-compute[74959]: WARNING nova.compute.manager [req-306a1a44-2b88-418d-9fad-1869f9cc473a req-a245bfe3-b4a9-43d8-b992-6af05f232258 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received unexpected event network-vif-plugged-cf3e934b-c8e7-4432-ae58-fe4282d0d384 for instance with vm_state active and task_state deleting.
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Instance destroyed successfully.
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'resources' on Instance uuid 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-982596722',display_name='tempest-AttachVolumeNegativeTest-server-982596722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-982596722',id=3,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlPnwu7GQA2w0/cXM0+s9KGC1jLnZT2BFNvj5QmR/UNUqmBoD+61qTWatpq01dkGykyIDUQsFo8WT01DjQdl+Nw8QCsIOS5HPbEC+NCpPQ6Lq9lP/NKeE/FgZicakhC3g==',key_name='tempest-keypair-1004908184',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-3mk5poe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "address": "fa:16:3e:d7:b0:e5", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3e934b-c8", "ovs_interfaceid": "cf3e934b-c8e7-4432-ae58-fe4282d0d384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:b0:e5,bridge_name='br-int',has_traffic_filtering=True,id=cf3e934b-c8e7-4432-ae58-fe4282d0d384,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3e934b-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_vif [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:b0:e5,bridge_name='br-int',has_traffic_filtering=True,id=cf3e934b-c8e7-4432-ae58-fe4282d0d384,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3e934b-c8') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f8e490-9b8a-4f0c-af8e-262d06672bdc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf3e934b-c8, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJOIHtDr {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d0c5a66-d378-459f-a979-ddd694d03d00) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:42 user nova-compute[74959]: INFO os_vif [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:b0:e5,bridge_name='br-int',has_traffic_filtering=True,id=cf3e934b-c8e7-4432-ae58-fe4282d0d384,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3e934b-c8')
Nov 28 23:04:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Deleting instance files /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe_del
Nov 28 23:04:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Deletion of /opt/stack/data/nova/instances/9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe_del complete
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJOIHtDr" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a0fc15-38a7-4cc5-b8c9-9df8bd2b9561]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJOIHtDr'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da6a70-d479-4d85-9dcd-cb71a48d636a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb90c429-e00d-49fe-a587-b331b0583e40]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: INFO nova.compute.manager [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ab06f-cef6-40e1-ba51-3d4228741bfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6, portal: 172.16.0.220,3260]
Nov 28 23:04:42 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6, portal: 172.16.0.220,3260] successful.
Nov 28 23:04:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[92423bb2-9ef0-42ed-b3dc-19722d9106e5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a50e58-4a33-4f26-8a83-eb21a805c623]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:04:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.596s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c1ef94-3197-4a05-9347-e79db557a26d]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:04:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJOIHtDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:04:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.738s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== connect_volume: return (2427ms) {'type': 'block', 'scsi_wwn': '26533393561626162', 'path': '/dev/sde'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533393561626162', 'path': '/dev/sde'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-25ab90b0-32c6-4270-a619-ced1ebbca7b5 req-54edf9eb-83c2-4e3c-8b27-73a85f876607 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Received event network-vif-deleted-cf3e934b-c8e7-4432-ae58-fe4282d0d384 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:44 user nova-compute[74959]: INFO nova.compute.manager [req-25ab90b0-32c6-4270-a619-ced1ebbca7b5 req-54edf9eb-83c2-4e3c-8b27-73a85f876607 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Neutron deleted interface cf3e934b-c8e7-4432-ae58-fe4282d0d384; detaching it from the instance and deleting it from the info cache
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.neutron [req-25ab90b0-32c6-4270-a619-ced1ebbca7b5 req-54edf9eb-83c2-4e3c-8b27-73a85f876607 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lazy-loading 'migration_context' on Instance uuid 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:44 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Took 1.36 seconds to deallocate network for instance.
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.objects.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Object Instance<7011df2d-f2c5-48ba-8d4c-d0539c235917> lazy-loaded attributes: resources,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-25ab90b0-32c6-4270-a619-ced1ebbca7b5 req-54edf9eb-83c2-4e3c-8b27-73a85f876607 service nova] [instance: 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe] Detach interface failed, port_id=cf3e934b-c8e7-4432-ae58-fe4282d0d384, reason: Instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:04:44 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:44 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7497MB free_disk=25.37108612060547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:59:9a,bridge_name='br-int',has_traffic_filtering=True,id=5f0717ec-fb17-491c-9652-75a0a2634da9,network=Network(e7c3c1e8-81cd-4480-bbee-6669822795e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f0717ec-fb') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:e9:4d,bridge_name='br-int',has_traffic_filtering=True,id=f1e08bcc-68c7-4755-80ea-ce3a8c134f7c,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1e08bcc-68') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:80,bridge_name='br-int',has_traffic_filtering=True,id=cea6f662-54ce-411f-98ba-d7c05acf8f59,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcea6f662-54') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ad:ef,bridge_name='br-int',has_traffic_filtering=True,id=50068be6-b4d5-4089-a0c6-a0b8b9ef7044,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50068be6-b4') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4f:e0,bridge_name='br-int',has_traffic_filtering=True,id=f893a0fc-a870-456c-bbf9-f00fd80130f5,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf893a0fc-a8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=8ea41a22-a65d-41ab-8658-fe14d9386822,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea41a22-a6') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:38:86,bridge_name='br-int',has_traffic_filtering=True,id=c16bdc9c-2454-43b3-b4c4-2f28ab154894,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16bdc9c-24') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lazy-loading 'pci_devices' on Instance uuid b3e1c6ff-87c8-48e7-8f05-693d26138bf5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:04:44 user nova-compute[74959]:   <uuid>b3e1c6ff-87c8-48e7-8f05-693d26138bf5</uuid>
Nov 28 23:04:44 user nova-compute[74959]:   <name>instance-00000011</name>
Nov 28 23:04:44 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:04:44 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:04:44 user nova-compute[74959]:   <metadata>
Nov 28 23:04:44 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:04:44 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:04:44 user nova-compute[74959]:       <nova:name>tempest-device-tagging-server-268298786</nova:name>
Nov 28 23:04:44 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:04:37</nova:creationTime>
Nov 28 23:04:44 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:04:44 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:04:44 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:04:44 user nova-compute[74959]:       <nova:owner>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:user uuid="c27e0181a13a424e936577bcca742d61">tempest-TaggedBootDevicesTest-835267361-project-member</nova:user>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:project uuid="2c5b887638a24af38c1641516bfb376e">tempest-TaggedBootDevicesTest-835267361</nova:project>
Nov 28 23:04:44 user nova-compute[74959]:       </nova:owner>
Nov 28 23:04:44 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:04:44 user nova-compute[74959]:       <nova:ports>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:port uuid="5f0717ec-fb17-491c-9652-75a0a2634da9">
Nov 28 23:04:44 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 23:04:44 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:port uuid="f1e08bcc-68c7-4755-80ea-ce3a8c134f7c">
Nov 28 23:04:44 user nova-compute[74959]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
Nov 28 23:04:44 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:port uuid="cea6f662-54ce-411f-98ba-d7c05acf8f59">
Nov 28 23:04:44 user nova-compute[74959]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Nov 28 23:04:44 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:port uuid="50068be6-b4d5-4089-a0c6-a0b8b9ef7044">
Nov 28 23:04:44 user nova-compute[74959]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
Nov 28 23:04:44 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:port uuid="f893a0fc-a870-456c-bbf9-f00fd80130f5">
Nov 28 23:04:44 user nova-compute[74959]:           <nova:ip type="fixed" address="10.1.1.63" ipVersion="4"/>
Nov 28 23:04:44 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:port uuid="8ea41a22-a65d-41ab-8658-fe14d9386822">
Nov 28 23:04:44 user nova-compute[74959]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 23:04:44 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:44 user nova-compute[74959]:         <nova:port uuid="c16bdc9c-2454-43b3-b4c4-2f28ab154894">
Nov 28 23:04:44 user nova-compute[74959]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 23:04:44 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:44 user nova-compute[74959]:       </nova:ports>
Nov 28 23:04:44 user nova-compute[74959]:     </nova:instance>
Nov 28 23:04:44 user nova-compute[74959]:   </metadata>
Nov 28 23:04:44 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:04:44 user nova-compute[74959]:     <system>
Nov 28 23:04:44 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:04:44 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:04:44 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:04:44 user nova-compute[74959]:       <entry name="serial">b3e1c6ff-87c8-48e7-8f05-693d26138bf5</entry>
Nov 28 23:04:44 user nova-compute[74959]:       <entry name="uuid">b3e1c6ff-87c8-48e7-8f05-693d26138bf5</entry>
Nov 28 23:04:44 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:04:44 user nova-compute[74959]:     </system>
Nov 28 23:04:44 user nova-compute[74959]:   </sysinfo>
Nov 28 23:04:44 user nova-compute[74959]:   <os>
Nov 28 23:04:44 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:04:44 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:04:44 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:04:44 user nova-compute[74959]:   </os>
Nov 28 23:04:44 user nova-compute[74959]:   <features>
Nov 28 23:04:44 user nova-compute[74959]:     <acpi/>
Nov 28 23:04:44 user nova-compute[74959]:     <apic/>
Nov 28 23:04:44 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:04:44 user nova-compute[74959]:   </features>
Nov 28 23:04:44 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:04:44 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:04:44 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:04:44 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:04:44 user nova-compute[74959]:   </clock>
Nov 28 23:04:44 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:04:44 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:04:44 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:04:44 user nova-compute[74959]:   </cpu>
Nov 28 23:04:44 user nova-compute[74959]:   <devices>
Nov 28 23:04:44 user nova-compute[74959]:     <disk type="file" device="cdrom">
Nov 28 23:04:44 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 23:04:44 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/b3e1c6ff-87c8-48e7-8f05-693d26138bf5/disk.config"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="hda" bus="ide"/>
Nov 28 23:04:44 user nova-compute[74959]:     </disk>
Nov 28 23:04:44 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:04:44 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:44 user nova-compute[74959]:       <source dev="/dev/sdf"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <serial>4c60692e-a677-4060-a1b8-b1a2c27068fa</serial>
Nov 28 23:04:44 user nova-compute[74959]:     </disk>
Nov 28 23:04:44 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:04:44 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:44 user nova-compute[74959]:       <source dev="/dev/sdh"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <serial>0faed3ce-1cd1-4bdd-9d34-176e4aa510b9</serial>
Nov 28 23:04:44 user nova-compute[74959]:     </disk>
Nov 28 23:04:44 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:04:44 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:44 user nova-compute[74959]:       <source dev="/dev/sde"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="vdc" bus="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <serial>a01a0d16-1ac9-4fd7-88bd-250245abdeb6</serial>
Nov 28 23:04:44 user nova-compute[74959]:     </disk>
Nov 28 23:04:44 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:44 user nova-compute[74959]:       <mac address="fa:16:3e:65:59:9a"/>
Nov 28 23:04:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="tap5f0717ec-fb"/>
Nov 28 23:04:44 user nova-compute[74959]:     </interface>
Nov 28 23:04:44 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:44 user nova-compute[74959]:       <mac address="fa:16:3e:35:e9:4d"/>
Nov 28 23:04:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="tapf1e08bcc-68"/>
Nov 28 23:04:44 user nova-compute[74959]:     </interface>
Nov 28 23:04:44 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:44 user nova-compute[74959]:       <mac address="fa:16:3e:d9:51:80"/>
Nov 28 23:04:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="tapcea6f662-54"/>
Nov 28 23:04:44 user nova-compute[74959]:     </interface>
Nov 28 23:04:44 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:44 user nova-compute[74959]:       <mac address="fa:16:3e:59:ad:ef"/>
Nov 28 23:04:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="tap50068be6-b4"/>
Nov 28 23:04:44 user nova-compute[74959]:     </interface>
Nov 28 23:04:44 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:44 user nova-compute[74959]:       <mac address="fa:16:3e:e8:4f:e0"/>
Nov 28 23:04:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="tapf893a0fc-a8"/>
Nov 28 23:04:44 user nova-compute[74959]:     </interface>
Nov 28 23:04:44 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:44 user nova-compute[74959]:       <mac address="fa:16:3e:80:f6:8b"/>
Nov 28 23:04:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="tap8ea41a22-a6"/>
Nov 28 23:04:44 user nova-compute[74959]:     </interface>
Nov 28 23:04:44 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:44 user nova-compute[74959]:       <mac address="fa:16:3e:38:38:86"/>
Nov 28 23:04:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:44 user nova-compute[74959]:       <target dev="tapc16bdc9c-24"/>
Nov 28 23:04:44 user nova-compute[74959]:     </interface>
Nov 28 23:04:44 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:04:44 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/b3e1c6ff-87c8-48e7-8f05-693d26138bf5/console.log" append="off"/>
Nov 28 23:04:44 user nova-compute[74959]:     </serial>
Nov 28 23:04:44 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:04:44 user nova-compute[74959]:     <video>
Nov 28 23:04:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:44 user nova-compute[74959]:     </video>
Nov 28 23:04:44 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:04:44 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:04:44 user nova-compute[74959]:     </rng>
Nov 28 23:04:44 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:04:44 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:04:44 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:04:44 user nova-compute[74959]:     </memballoon>
Nov 28 23:04:44 user nova-compute[74959]:   </devices>
Nov 28 23:04:44 user nova-compute[74959]: </domain>
Nov 28 23:04:44 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:59:9a,bridge_name='br-int',has_traffic_filtering=True,id=5f0717ec-fb17-491c-9652-75a0a2634da9,network=Network(e7c3c1e8-81cd-4480-bbee-6669822795e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f0717ec-fb') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:59:9a,bridge_name='br-int',has_traffic_filtering=True,id=5f0717ec-fb17-491c-9652-75a0a2634da9,network=Network(e7c3c1e8-81cd-4480-bbee-6669822795e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f0717ec-fb') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77bbf764-02ed-5f89-84b5-e64069dc71d8', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f0717ec-fb, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f0717ec-fb, col_values=(('qos', UUID('edebc04d-c7c3-47f3-820d-6a4b9fb9c216')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f0717ec-fb, col_values=(('external_ids', {'iface-id': '5f0717ec-fb17-491c-9652-75a0a2634da9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:59:9a', 'vm-uuid': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: INFO os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:59:9a,bridge_name='br-int',has_traffic_filtering=True,id=5f0717ec-fb17-491c-9652-75a0a2634da9,network=Network(e7c3c1e8-81cd-4480-bbee-6669822795e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f0717ec-fb')
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:e9:4d,bridge_name='br-int',has_traffic_filtering=True,id=f1e08bcc-68c7-4755-80ea-ce3a8c134f7c,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1e08bcc-68') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:e9:4d,bridge_name='br-int',has_traffic_filtering=True,id=f1e08bcc-68c7-4755-80ea-ce3a8c134f7c,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1e08bcc-68') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a611cd5-67ed-5c5e-a948-70f0e7d109a7', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1e08bcc-68, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1e08bcc-68, col_values=(('qos', UUID('aa543a21-2981-4058-8e79-310cfa2a5914')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1e08bcc-68, col_values=(('external_ids', {'iface-id': 'f1e08bcc-68c7-4755-80ea-ce3a8c134f7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:e9:4d', 'vm-uuid': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: INFO os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:e9:4d,bridge_name='br-int',has_traffic_filtering=True,id=f1e08bcc-68c7-4755-80ea-ce3a8c134f7c,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1e08bcc-68')
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:80,bridge_name='br-int',has_traffic_filtering=True,id=cea6f662-54ce-411f-98ba-d7c05acf8f59,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcea6f662-54') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:80,bridge_name='br-int',has_traffic_filtering=True,id=cea6f662-54ce-411f-98ba-d7c05acf8f59,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcea6f662-54') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11c9cba4-20b6-58a6-bdf5-4990f566cbcc', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcea6f662-54, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcea6f662-54, col_values=(('qos', UUID('29870344-a5de-4a95-aaef-66be6c4d970a')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcea6f662-54, col_values=(('external_ids', {'iface-id': 'cea6f662-54ce-411f-98ba-d7c05acf8f59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:51:80', 'vm-uuid': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: INFO os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:80,bridge_name='br-int',has_traffic_filtering=True,id=cea6f662-54ce-411f-98ba-d7c05acf8f59,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcea6f662-54')
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ad:ef,bridge_name='br-int',has_traffic_filtering=True,id=50068be6-b4d5-4089-a0c6-a0b8b9ef7044,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50068be6-b4') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ad:ef,bridge_name='br-int',has_traffic_filtering=True,id=50068be6-b4d5-4089-a0c6-a0b8b9ef7044,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50068be6-b4') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04b9614b-a650-507b-9149-047e9258dfd4', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50068be6-b4, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50068be6-b4, col_values=(('qos', UUID('2570784e-000f-468a-84b9-b574e41df4de')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50068be6-b4, col_values=(('external_ids', {'iface-id': '50068be6-b4d5-4089-a0c6-a0b8b9ef7044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:ad:ef', 'vm-uuid': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: INFO os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ad:ef,bridge_name='br-int',has_traffic_filtering=True,id=50068be6-b4d5-4089-a0c6-a0b8b9ef7044,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50068be6-b4')
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4f:e0,bridge_name='br-int',has_traffic_filtering=True,id=f893a0fc-a870-456c-bbf9-f00fd80130f5,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf893a0fc-a8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4f:e0,bridge_name='br-int',has_traffic_filtering=True,id=f893a0fc-a870-456c-bbf9-f00fd80130f5,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf893a0fc-a8') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3e3d14e-a04f-5d4c-9de7-d6ee30f32eb9', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf893a0fc-a8, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf893a0fc-a8, col_values=(('qos', UUID('7243bc34-2ffe-4ac8-b330-7c90de704b77')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf893a0fc-a8, col_values=(('external_ids', {'iface-id': 'f893a0fc-a870-456c-bbf9-f00fd80130f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:4f:e0', 'vm-uuid': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: INFO os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4f:e0,bridge_name='br-int',has_traffic_filtering=True,id=f893a0fc-a870-456c-bbf9-f00fd80130f5,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf893a0fc-a8')
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=8ea41a22-a65d-41ab-8658-fe14d9386822,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea41a22-a6') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=8ea41a22-a65d-41ab-8658-fe14d9386822,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea41a22-a6') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02fc306e-c80a-542d-ad54-1c64bbf283e8', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea41a22-a6, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ea41a22-a6, col_values=(('qos', UUID('db36c874-b64a-4bd5-a940-e25ac6c6fd40')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ea41a22-a6, col_values=(('external_ids', {'iface-id': '8ea41a22-a65d-41ab-8658-fe14d9386822', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:f6:8b', 'vm-uuid': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: INFO os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=8ea41a22-a65d-41ab-8658-fe14d9386822,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea41a22-a6')
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:38:86,bridge_name='br-int',has_traffic_filtering=True,id=c16bdc9c-2454-43b3-b4c4-2f28ab154894,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16bdc9c-24') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:38:86,bridge_name='br-int',has_traffic_filtering=True,id=c16bdc9c-2454-43b3-b4c4-2f28ab154894,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16bdc9c-24') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb856364-62d3-573c-a48a-ac1775f17814', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc16bdc9c-24, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc16bdc9c-24, col_values=(('qos', UUID('efe775e7-93d9-4ee6-ae2c-79152c084b29')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc16bdc9c-24, col_values=(('external_ids', {'iface-id': 'c16bdc9c-2454-43b3-b4c4-2f28ab154894', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:38:86', 'vm-uuid': 'b3e1c6ff-87c8-48e7-8f05-693d26138bf5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:44 user nova-compute[74959]: INFO os_vif [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:38:86,bridge_name='br-int',has_traffic_filtering=True,id=c16bdc9c-2454-43b3-b4c4-2f28ab154894,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16bdc9c-24')
Nov 28 23:04:44 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] No BDM found with device name hda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] No VIF found with MAC fa:16:3e:65:59:9a, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] No VIF found with MAC fa:16:3e:e8:4f:e0, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:04:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Using config drive
Nov 28 23:04:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.048s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.982s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:45 user nova-compute[74959]: INFO nova.compute.manager [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Detaching volume f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: WARNING nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d339c51b-2c03-4ac9-800f-b5dc053e0585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 94b085b2-b298-4780-be94-21f85c799945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: INFO nova.compute.manager [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Swapping old allocation on dict_keys(['54851fe4-2867-4d3c-b2f3-bede5755a160']) held by migration b318f89d-2e43-487c-9893-9dd914b299ab for instance
Nov 28 23:04:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Creating config drive at /opt/stack/data/nova/instances/b3e1c6ff-87c8-48e7-8f05-693d26138bf5/disk.config
Nov 28 23:04:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b3e1c6ff-87c8-48e7-8f05-693d26138bf5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1fegqagm {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:45 user nova-compute[74959]: INFO nova.virt.block_device [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Attempting to driver detach volume f4f19256-661e-4d78-bfb7-ed5e50539ebf from mountpoint /dev/vdb
Nov 28 23:04:45 user nova-compute[74959]: INFO nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b318f89d-2e43-487c-9893-9dd914b299ab has allocations against this compute host but is not found in the database.
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e1174ec3-4ec5-4538-b304-60c76ec41bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b3e1c6ff-87c8-48e7-8f05-693d26138bf5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Overwriting current allocation {'allocations': {'54851fe4-2867-4d3c-b2f3-bede5755a160': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '5e566d89eec64455b5bdb1b105bfe9a0', 'user_id': '911d51b00a8e442cbe38d5e511edba81', 'consumer_generation': 1} on consumer 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b3e1c6ff-87c8-48e7-8f05-693d26138bf5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1fegqagm" returned: 0 in 0.086s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Attempting to detach device vdb from instance 9492b249-758e-4b8f-acfb-f334ef80a9dd from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:04:45 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:45 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:04:45 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:04:45 user nova-compute[74959]:   <serial>f4f19256-661e-4d78-bfb7-ed5e50539ebf</serial>
Nov 28 23:04:45 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 23:04:45 user nova-compute[74959]: </disk>
Nov 28 23:04:45 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:04:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully detached device vdb from instance 9492b249-758e-4b8f-acfb-f334ef80a9dd from the persistent domain config.
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9492b249-758e-4b8f-acfb-f334ef80a9dd from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:04:45 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:45 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:04:45 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:04:45 user nova-compute[74959]:   <serial>f4f19256-661e-4d78-bfb7-ed5e50539ebf</serial>
Nov 28 23:04:45 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 23:04:45 user nova-compute[74959]: </disk>
Nov 28 23:04:45 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquired lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:04:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.953s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.884s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.007s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:04:46 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Deleted allocations for instance 9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe
Nov 28 23:04:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d17317ef-87fd-453a-a317-d4f166347560 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "9cd6ba4d-ea60-4641-9cdc-a42730ddf6fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.753s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG nova.network.neutron [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Releasing lock "refresh_cache-7011df2d-f2c5-48ba-8d4c-d0539c235917" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaf959e-b41e-45a1-b6d1-0af099614e50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[97978dc4-7cd5-46d9-b92c-79ad959b54a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[97655fef-4159-40bc-ad10-2858469caea3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdec3df-ef3a-4697-b04e-60053fd7f758]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:04:46 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:04:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b9e2ba-c03e-4478-acd8-80ff20fd5091]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:04:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-5016f6b8-1c11-4c6c-a53e-55829efc3170 req-bc17af6f-e7b7-47f2-81d4-d06a5d17ae3b service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5016f6b8-1c11-4c6c-a53e-55829efc3170 req-bc17af6f-e7b7-47f2-81d4-d06a5d17ae3b service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5016f6b8-1c11-4c6c-a53e-55829efc3170 req-bc17af6f-e7b7-47f2-81d4-d06a5d17ae3b service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5016f6b8-1c11-4c6c-a53e-55829efc3170 req-bc17af6f-e7b7-47f2-81d4-d06a5d17ae3b service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-5016f6b8-1c11-4c6c-a53e-55829efc3170 req-bc17af6f-e7b7-47f2-81d4-d06a5d17ae3b service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:47 user nova-compute[74959]: WARNING nova.compute.manager [req-5016f6b8-1c11-4c6c-a53e-55829efc3170 req-bc17af6f-e7b7-47f2-81d4-d06a5d17ae3b service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 for instance with vm_state building and task_state spawning.
Nov 28 23:04:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-fe74ea1d-555b-4552-90fc-d0c0b5c71f6f req-c08f6b3b-d14c-494b-88ba-b4326a9c3a1c service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe74ea1d-555b-4552-90fc-d0c0b5c71f6f req-c08f6b3b-d14c-494b-88ba-b4326a9c3a1c service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe74ea1d-555b-4552-90fc-d0c0b5c71f6f req-c08f6b3b-d14c-494b-88ba-b4326a9c3a1c service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe74ea1d-555b-4552-90fc-d0c0b5c71f6f req-c08f6b3b-d14c-494b-88ba-b4326a9c3a1c service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-fe74ea1d-555b-4552-90fc-d0c0b5c71f6f req-c08f6b3b-d14c-494b-88ba-b4326a9c3a1c service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:48 user nova-compute[74959]: WARNING nova.compute.manager [req-fe74ea1d-555b-4552-90fc-d0c0b5c71f6f req-c08f6b3b-d14c-494b-88ba-b4326a9c3a1c service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 for instance with vm_state building and task_state spawning.
Nov 28 23:04:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:48 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 94b085b2-b298-4780-be94-21f85c799945 is timed out.
Nov 28 23:04:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully detached device vdc from instance 94b085b2-b298-4780-be94-21f85c799945 from the live domain config.
Nov 28 23:04:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OulVWEAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:48 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c664a5ab-02bf-4ba6-8667-0cfbf82fa7db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:04:48 user nova-compute[74959]: No targets found.
Nov 28 23:04:48 user nova-compute[74959]: iSNS:
Nov 28 23:04:48 user nova-compute[74959]: No targets found.
Nov 28 23:04:48 user nova-compute[74959]: STATIC:
Nov 28 23:04:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966
Nov 28 23:04:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:04:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6
Nov 28 23:04:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:04:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa
Nov 28 23:04:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9
Nov 28 23:04:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:48 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:04:48 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:04:48 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:04:48 user nova-compute[74959]: FIRMWARE:
Nov 28 23:04:48 user nova-compute[74959]: No targets found.
Nov 28 23:04:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:04:48 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:04:48 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:04:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.055s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[669725be-f4da-49c6-a511-52ecd51909a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f2915-71b5-4b6a-bdc2-be3de0368cad]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:04:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:49 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:04:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc7d1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966'): ({'sdd'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Removing single pathed devices sdd {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[22733d63-d839-490e-8fc7-e5467f93e2fa]: (4, ('path checker states:\nup                  5\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-d2ca14e9-2017-44ba-8804-64b3a7cb799a req-a4a75e2e-0c21-4aab-8f05-7946442c04b7 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d2ca14e9-2017-44ba-8804-64b3a7cb799a req-a4a75e2e-0c21-4aab-8f05-7946442c04b7 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d2ca14e9-2017-44ba-8804-64b3a7cb799a req-a4a75e2e-0c21-4aab-8f05-7946442c04b7 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d2ca14e9-2017-44ba-8804-64b3a7cb799a req-a4a75e2e-0c21-4aab-8f05-7946442c04b7 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-d2ca14e9-2017-44ba-8804-64b3a7cb799a req-a4a75e2e-0c21-4aab-8f05-7946442c04b7 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:49 user nova-compute[74959]: WARNING nova.compute.manager [req-d2ca14e9-2017-44ba-8804-64b3a7cb799a req-a4a75e2e-0c21-4aab-8f05-7946442c04b7 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 for instance with vm_state building and task_state spawning.
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac6806-3b3a-4c25-89ef-aa1795bfd82a]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flushing IO for device /dev/sdd {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c326d3-96cf-4000-b0c1-3f2d57779c52]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b9522e-a05f-4e09-a5bb-8c0522a25462]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae4667-e055-45de-ba51-8cbe2aec503e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --logout" returned: 0 in 0.117s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d522dc51-f60b-4a36-a5de-a55361a8837f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966, portal: 172.16.0.220,3260]
Nov 28 23:04:49 user nova-compute[74959]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966, portal: 172.16.0.220,3260] successful.
Nov 28 23:04:49 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18f67820-210f-46b7-8bf3-4b786b77b966 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3618e44a-6a98-43bc-a839-7c578ad40492]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.575s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] <== disconnect_volume: return (577ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:50 user nova-compute[74959]: WARNING nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 for instance with vm_state building and task_state spawning.
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:50 user nova-compute[74959]: WARNING nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c for instance with vm_state building and task_state spawning.
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:50 user nova-compute[74959]: WARNING nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c for instance with vm_state building and task_state spawning.
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:50 user nova-compute[74959]: WARNING nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 for instance with vm_state building and task_state spawning.
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:50 user nova-compute[74959]: WARNING nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 for instance with vm_state building and task_state spawning.
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:50 user nova-compute[74959]: WARNING nova.compute.manager [req-28778876-7f43-4572-9779-2b6df97062f4 req-d5226f88-5bc9-42cc-8a8c-d63dd0529ec3 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 for instance with vm_state building and task_state spawning.
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.objects.instance [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'flavor' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edb43e73-daed-4d85-80c9-94c3392d79c4 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.482s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-0211314c-d9e6-4038-9acc-7d628751d1ca req-37a38632-4001-4384-a644-65cda459ec93 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0211314c-d9e6-4038-9acc-7d628751d1ca req-37a38632-4001-4384-a644-65cda459ec93 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0211314c-d9e6-4038-9acc-7d628751d1ca req-37a38632-4001-4384-a644-65cda459ec93 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0211314c-d9e6-4038-9acc-7d628751d1ca req-37a38632-4001-4384-a644-65cda459ec93 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-0211314c-d9e6-4038-9acc-7d628751d1ca req-37a38632-4001-4384-a644-65cda459ec93 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:50 user nova-compute[74959]: WARNING nova.compute.manager [req-0211314c-d9e6-4038-9acc-7d628751d1ca req-37a38632-4001-4384-a644-65cda459ec93 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 for instance with vm_state building and task_state spawning.
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-89148869-ff00-4288-9fe2-5a0dea8cd83a req-8e258ab6-0dda-4a14-9b1f-dc7c228c0ebb service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-89148869-ff00-4288-9fe2-5a0dea8cd83a req-8e258ab6-0dda-4a14-9b1f-dc7c228c0ebb service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-89148869-ff00-4288-9fe2-5a0dea8cd83a req-8e258ab6-0dda-4a14-9b1f-dc7c228c0ebb service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-89148869-ff00-4288-9fe2-5a0dea8cd83a req-8e258ab6-0dda-4a14-9b1f-dc7c228c0ebb service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-89148869-ff00-4288-9fe2-5a0dea8cd83a req-8e258ab6-0dda-4a14-9b1f-dc7c228c0ebb service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:52 user nova-compute[74959]: WARNING nova.compute.manager [req-89148869-ff00-4288-9fe2-5a0dea8cd83a req-8e258ab6-0dda-4a14-9b1f-dc7c228c0ebb service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 for instance with vm_state building and task_state spawning.
Nov 28 23:04:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:52 user nova-compute[74959]: WARNING nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 for instance with vm_state building and task_state spawning.
Nov 28 23:04:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:52 user nova-compute[74959]: WARNING nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 for instance with vm_state building and task_state spawning.
Nov 28 23:04:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:52 user nova-compute[74959]: WARNING nova.compute.manager [req-bd5d66a4-afdf-4ee3-b676-0a3d2519d302 req-b690d53a-410f-4021-9d27-5cccf52222c0 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 for instance with vm_state building and task_state spawning.
Nov 28 23:04:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:04:53 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance spawned successfully.
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:04:53 user nova-compute[74959]: INFO nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Took 15.36 seconds to spawn the instance on the hypervisor.
Nov 28 23:04:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:04:53 user nova-compute[74959]: INFO nova.compute.manager [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Took 46.14 seconds to build instance.
Nov 28 23:04:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa86c6f-5e43-4bfe-8d73-402768c7b9ba tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.258s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Starting finish_revert_migration {{(pid=74959) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Start _get_guest_xml network_info=[{"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7011df2d-f2c5-48ba-8d4c-d0539c235917', 'attached_at': '2023-11-28T23:04:56.000000', 'detached_at': '', 'volume_id': 'b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'serial': 'b5e6b154-a7cf-41bf-b0c8-a559df5579b2'}, 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '188799ea-b38d-4ba5-947f-5588f96b01ce', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:04:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.objects.instance [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:04:55 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:55 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:04:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:04:55 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:04:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b372d5-ad4c-47b1-b426-c4403ede8aa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:04:55 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[089d540d-21ac-49da-bb30-c6e7e4ffd8f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2] added
Nov 28 23:04:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd12d0a-2d39-4b16-bec8-54cd78c1dc98]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0461dc9-bf7a-4f2d-81f4-e85d81cbca80]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGrXlNba {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGrXlNba" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be38871-0ae4-43cb-a767-49f6110a4e06]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGrXlNba'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e608fba-38ec-4c54-91a5-0ef8e416708c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de5d33-bb7f-43f7-b73b-b7ebbd83178c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffdcae6-d784-4aca-aded-e56202c5c862]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]
Nov 28 23:04:56 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.
Nov 28 23:04:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fa3bb3-f412-4782-89b0-25c1b27e2a94]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee3f0c2-a489-47e1-bf66-2e01571afa8e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:04:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23dbb6b-f225-4cbc-8f48-c4b768620ff3]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:04:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26438343433343563', 'path': '/dev/sdd'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438343433343563', 'path': '/dev/sdd'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:03:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:04:57 user nova-compute[74959]:   <uuid>7011df2d-f2c5-48ba-8d4c-d0539c235917</uuid>
Nov 28 23:04:57 user nova-compute[74959]:   <name>instance-00000004</name>
Nov 28 23:04:57 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:04:57 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:04:57 user nova-compute[74959]:   <metadata>
Nov 28 23:04:57 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:04:57 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:04:57 user nova-compute[74959]:       <nova:name>tempest-ServerActionsTestOtherB-server-1175671381</nova:name>
Nov 28 23:04:57 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:04:55</nova:creationTime>
Nov 28 23:04:57 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:04:57 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:04:57 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:04:57 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:04:57 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:04:57 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:04:57 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:04:57 user nova-compute[74959]:       <nova:owner>
Nov 28 23:04:57 user nova-compute[74959]:         <nova:user uuid="911d51b00a8e442cbe38d5e511edba81">tempest-ServerActionsTestOtherB-152667612-project-member</nova:user>
Nov 28 23:04:57 user nova-compute[74959]:         <nova:project uuid="5e566d89eec64455b5bdb1b105bfe9a0">tempest-ServerActionsTestOtherB-152667612</nova:project>
Nov 28 23:04:57 user nova-compute[74959]:       </nova:owner>
Nov 28 23:04:57 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:04:57 user nova-compute[74959]:       <nova:ports>
Nov 28 23:04:57 user nova-compute[74959]:         <nova:port uuid="67663953-c88b-4b51-88e5-2904a213a0ef">
Nov 28 23:04:57 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 23:04:57 user nova-compute[74959]:         </nova:port>
Nov 28 23:04:57 user nova-compute[74959]:       </nova:ports>
Nov 28 23:04:57 user nova-compute[74959]:     </nova:instance>
Nov 28 23:04:57 user nova-compute[74959]:   </metadata>
Nov 28 23:04:57 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:04:57 user nova-compute[74959]:     <system>
Nov 28 23:04:57 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:04:57 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:04:57 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:04:57 user nova-compute[74959]:       <entry name="serial">7011df2d-f2c5-48ba-8d4c-d0539c235917</entry>
Nov 28 23:04:57 user nova-compute[74959]:       <entry name="uuid">7011df2d-f2c5-48ba-8d4c-d0539c235917</entry>
Nov 28 23:04:57 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:04:57 user nova-compute[74959]:     </system>
Nov 28 23:04:57 user nova-compute[74959]:   </sysinfo>
Nov 28 23:04:57 user nova-compute[74959]:   <os>
Nov 28 23:04:57 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:04:57 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:04:57 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:04:57 user nova-compute[74959]:   </os>
Nov 28 23:04:57 user nova-compute[74959]:   <features>
Nov 28 23:04:57 user nova-compute[74959]:     <acpi/>
Nov 28 23:04:57 user nova-compute[74959]:     <apic/>
Nov 28 23:04:57 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:04:57 user nova-compute[74959]:   </features>
Nov 28 23:04:57 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:04:57 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:04:57 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:04:57 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:04:57 user nova-compute[74959]:   </clock>
Nov 28 23:04:57 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:04:57 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:04:57 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:04:57 user nova-compute[74959]:   </cpu>
Nov 28 23:04:57 user nova-compute[74959]:   <devices>
Nov 28 23:04:57 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:04:57 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:04:57 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk"/>
Nov 28 23:04:57 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:04:57 user nova-compute[74959]:     </disk>
Nov 28 23:04:57 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:04:57 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:04:57 user nova-compute[74959]:       <source dev="/dev/sdd"/>
Nov 28 23:04:57 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:04:57 user nova-compute[74959]:       <serial>b5e6b154-a7cf-41bf-b0c8-a559df5579b2</serial>
Nov 28 23:04:57 user nova-compute[74959]:     </disk>
Nov 28 23:04:57 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:04:57 user nova-compute[74959]:       <mac address="fa:16:3e:b4:83:ed"/>
Nov 28 23:04:57 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:57 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:04:57 user nova-compute[74959]:       <target dev="tap67663953-c8"/>
Nov 28 23:04:57 user nova-compute[74959]:     </interface>
Nov 28 23:04:57 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:04:57 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/console.log" append="off"/>
Nov 28 23:04:57 user nova-compute[74959]:     </serial>
Nov 28 23:04:57 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:04:57 user nova-compute[74959]:     <video>
Nov 28 23:04:57 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:04:57 user nova-compute[74959]:     </video>
Nov 28 23:04:57 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:04:57 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:04:57 user nova-compute[74959]:     </rng>
Nov 28 23:04:57 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:04:57 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:04:57 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:04:57 user nova-compute[74959]:     </memballoon>
Nov 28 23:04:57 user nova-compute[74959]:   </devices>
Nov 28 23:04:57 user nova-compute[74959]: </domain>
Nov 28 23:04:57 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:03:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG os_vif [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b275aac-4ead-5f59-b12c-ac3d1ffce5b1', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67663953-c8, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67663953-c8, col_values=(('qos', UUID('e96fa09f-3894-44f4-a1c5-5209b71a1977')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67663953-c8, col_values=(('external_ids', {'iface-id': '67663953-c88b-4b51-88e5-2904a213a0ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:83:ed', 'vm-uuid': '7011df2d-f2c5-48ba-8d4c-d0539c235917'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:57 user nova-compute[74959]: INFO os_vif [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8')
Nov 28 23:04:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-b8019768-7f63-4e30-b8ff-3269e40aff32 req-da5c0045-066b-4543-b100-8802a72c4590 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:04:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b8019768-7f63-4e30-b8ff-3269e40aff32 req-da5c0045-066b-4543-b100-8802a72c4590 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:04:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b8019768-7f63-4e30-b8ff-3269e40aff32 req-da5c0045-066b-4543-b100-8802a72c4590 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:04:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b8019768-7f63-4e30-b8ff-3269e40aff32 req-da5c0045-066b-4543-b100-8802a72c4590 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:04:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-b8019768-7f63-4e30-b8ff-3269e40aff32 req-da5c0045-066b-4543-b100-8802a72c4590 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:04:59 user nova-compute[74959]: WARNING nova.compute.manager [req-b8019768-7f63-4e30-b8ff-3269e40aff32 req-da5c0045-066b-4543-b100-8802a72c4590 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state resized and task_state resize_reverting.
Nov 28 23:04:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:04:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-137b92cf-5b35-4630-a583-88de5c7d83d3 req-34c10826-0166-4058-ad1a-c74a09394b7e service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-137b92cf-5b35-4630-a583-88de5c7d83d3 req-34c10826-0166-4058-ad1a-c74a09394b7e service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-137b92cf-5b35-4630-a583-88de5c7d83d3 req-34c10826-0166-4058-ad1a-c74a09394b7e service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-137b92cf-5b35-4630-a583-88de5c7d83d3 req-34c10826-0166-4058-ad1a-c74a09394b7e service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-137b92cf-5b35-4630-a583-88de5c7d83d3 req-34c10826-0166-4058-ad1a-c74a09394b7e service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:01 user nova-compute[74959]: WARNING nova.compute.manager [req-137b92cf-5b35-4630-a583-88de5c7d83d3 req-34c10826-0166-4058-ad1a-c74a09394b7e service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state resized and task_state resize_reverting.
Nov 28 23:05:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:05:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance running successfully.
Nov 28 23:05:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] finish_revert_migration finished successfully. {{(pid=74959) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 23:05:01 user nova-compute[74959]: INFO nova.compute.manager [None req-dc2b5ca9-0c3c-4269-bac1-5f2ad90ba1c2 tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance to original state: 'active'
Nov 28 23:05:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:05 user nova-compute[74959]: INFO nova.compute.manager [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Terminating instance
Nov 28 23:05:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9492b249-758e-4b8f-acfb-f334ef80a9dd is timed out.
Nov 28 23:05:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully detached device vdb from instance 9492b249-758e-4b8f-acfb-f334ef80a9dd from the live domain config.
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsPoIUeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:05:06 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb79ade5-b933-44d8-98db-73ee85b9658c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:05:06 user nova-compute[74959]: No targets found.
Nov 28 23:05:06 user nova-compute[74959]: iSNS:
Nov 28 23:05:06 user nova-compute[74959]: No targets found.
Nov 28 23:05:06 user nova-compute[74959]: STATIC:
Nov 28 23:05:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:05:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf
Nov 28 23:05:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6
Nov 28 23:05:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:05:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa
Nov 28 23:05:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9
Nov 28 23:05:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:05:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:06 user nova-compute[74959]: FIRMWARE:
Nov 28 23:05:06 user nova-compute[74959]: No targets found.
Nov 28 23:05:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:05:06 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:05:06 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.038s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e09df2-8f22-4157-ac29-8a0c04a94367]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-9fb8b8e0-cb24-4a90-b599-4008bfd667cd req-f1aaf5a0-ab3b-448d-8bbe-9eee828076fb service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received event network-vif-unplugged-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9fb8b8e0-cb24-4a90-b599-4008bfd667cd req-f1aaf5a0-ab3b-448d-8bbe-9eee828076fb service nova] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9fb8b8e0-cb24-4a90-b599-4008bfd667cd req-f1aaf5a0-ab3b-448d-8bbe-9eee828076fb service nova] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9fb8b8e0-cb24-4a90-b599-4008bfd667cd req-f1aaf5a0-ab3b-448d-8bbe-9eee828076fb service nova] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-9fb8b8e0-cb24-4a90-b599-4008bfd667cd req-f1aaf5a0-ab3b-448d-8bbe-9eee828076fb service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] No waiting events found dispatching network-vif-unplugged-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-9fb8b8e0-cb24-4a90-b599-4008bfd667cd req-f1aaf5a0-ab3b-448d-8bbe-9eee828076fb service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received event network-vif-unplugged-62a02076-f272-41c6-aa3a-f49c904dfa68 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6591ec5a-a6d7-4142-b678-0160a913d59d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:05:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:05:06 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:05:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef478bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d402ecee-8eec-4a5b-b6b8-e321c915aa16]: (4, ('path checker states:\nup                  5\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3d4f3-0175-4581-9d42-3e5b62363bf4]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1b0b87-bbff-4973-b130-e45b23d06573]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d5f18-8a92-42a0-b220-613a891e4398]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a999249-500e-4ae9-8943-5b23761b1416]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Instance destroyed successfully.
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lazy-loading 'resources' on Instance uuid d339c51b-2c03-4ac9-800f-b5dc053e0585 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1357588568',display_name='tempest-VolumesAdminNegativeTest-server-1357588568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1357588568',id=7,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFe4mgQ8aGd7KKF0BVgVScxJwhOUwBkKbQcRp3MP91XXKmZt0h9WklD1o5VUgQZbBBUWQCB+VOGq0FcpWI/nby/M47xclpEjJAEuRZXEn8l671LoBKR1pNoAvw8M82PUQ==',key_name='tempest-keypair-1068431521',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29ef9d9fe9334bb19ddccc256847afcc',ramdisk_id='',reservation_id='r-ukpvxxj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1277404831',owner_user_name='tempest-VolumesAdminNegativeTest-1277404831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T22:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b801c03a17a54b2dbb2d7d7e1a708126',uuid=d339c51b-2c03-4ac9-800f-b5dc053e0585,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converting VIF {"id": "62a02076-f272-41c6-aa3a-f49c904dfa68", "address": "fa:16:3e:d6:86:26", "network": {"id": "4f254b51-640f-44f1-80c0-e63604a55f9f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-883181648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef9d9fe9334bb19ddccc256847afcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62a02076-f2", "ovs_interfaceid": "62a02076-f272-41c6-aa3a-f49c904dfa68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:86:26,bridge_name='br-int',has_traffic_filtering=True,id=62a02076-f272-41c6-aa3a-f49c904dfa68,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a02076-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_vif [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:86:26,bridge_name='br-int',has_traffic_filtering=True,id=62a02076-f272-41c6-aa3a-f49c904dfa68,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a02076-f2') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --logout" returned: 0 in 0.134s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d665d34-7a14-4f55-b9c7-e2592dca097a]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62a02076-f2, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260]
Nov 28 23:05:06 user nova-compute[74959]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf, portal: 172.16.0.220,3260] successful.
Nov 28 23:05:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71c6d03a-2400-4bff-bbd3-eb583b591c2c) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:06 user nova-compute[74959]: INFO os_vif [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:86:26,bridge_name='br-int',has_traffic_filtering=True,id=62a02076-f272-41c6-aa3a-f49c904dfa68,network=Network(4f254b51-640f-44f1-80c0-e63604a55f9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62a02076-f2')
Nov 28 23:05:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Deleting instance files /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585_del
Nov 28 23:05:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Deletion of /opt/stack/data/nova/instances/d339c51b-2c03-4ac9-800f-b5dc053e0585_del complete
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f19256-661e-4d78-bfb7-ed5e50539ebf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b51e85b-be33-46b9-abed-987717749979]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.509s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== disconnect_volume: return (510ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:05:06 user nova-compute[74959]: INFO nova.compute.manager [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 23:05:06 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:05:06 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:05:07 user nova-compute[74959]: DEBUG nova.objects.instance [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:05:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5d7d00ac-ff72-44f5-9def-2c18aff9a661 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.426s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:07 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:07 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Took 0.96 seconds to deallocate network for instance.
Nov 28 23:05:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:08 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Deleted allocations for instance d339c51b-2c03-4ac9-800f-b5dc053e0585
Nov 28 23:05:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1279cd1-96a4-4599-99c6-5770ed4f8437 tempest-VolumesAdminNegativeTest-1277404831 tempest-VolumesAdminNegativeTest-1277404831-project-member] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-438c5624-ec33-4367-a42c-84352cdab226 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-438c5624-ec33-4367-a42c-84352cdab226 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-438c5624-ec33-4367-a42c-84352cdab226 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-438c5624-ec33-4367-a42c-84352cdab226 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74959) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG nova.objects.instance [None req-438c5624-ec33-4367-a42c-84352cdab226 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-8ee7efea-3c50-4179-862b-812ed4ae3538 req-0ba6ce38-42b2-4ecb-99f4-f68b8b120322 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received event network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8ee7efea-3c50-4179-862b-812ed4ae3538 req-0ba6ce38-42b2-4ecb-99f4-f68b8b120322 service nova] Acquiring lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8ee7efea-3c50-4179-862b-812ed4ae3538 req-0ba6ce38-42b2-4ecb-99f4-f68b8b120322 service nova] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8ee7efea-3c50-4179-862b-812ed4ae3538 req-0ba6ce38-42b2-4ecb-99f4-f68b8b120322 service nova] Lock "d339c51b-2c03-4ac9-800f-b5dc053e0585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-8ee7efea-3c50-4179-862b-812ed4ae3538 req-0ba6ce38-42b2-4ecb-99f4-f68b8b120322 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] No waiting events found dispatching network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:08 user nova-compute[74959]: WARNING nova.compute.manager [req-8ee7efea-3c50-4179-862b-812ed4ae3538 req-0ba6ce38-42b2-4ecb-99f4-f68b8b120322 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received unexpected event network-vif-plugged-62a02076-f272-41c6-aa3a-f49c904dfa68 for instance with vm_state deleted and task_state None.
Nov 28 23:05:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-8ee7efea-3c50-4179-862b-812ed4ae3538 req-0ba6ce38-42b2-4ecb-99f4-f68b8b120322 service nova] [instance: d339c51b-2c03-4ac9-800f-b5dc053e0585] Received event network-vif-deleted-62a02076-f272-41c6-aa3a-f49c904dfa68 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:09 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance destroyed successfully.
Nov 28 23:05:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-438c5624-ec33-4367-a42c-84352cdab226 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:05:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-438c5624-ec33-4367-a42c-84352cdab226 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.896s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:10 user nova-compute[74959]: WARNING nova.compute.manager [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state stopped and task_state None.
Nov 28 23:05:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:10 user nova-compute[74959]: WARNING nova.compute.manager [req-eead7a47-b601-48d0-b06c-a35a99c98559 req-62936deb-06b7-4bac-a78f-e025d5259182 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state stopped and task_state None.
Nov 28 23:05:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "94b085b2-b298-4780-be94-21f85c799945-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:18 user nova-compute[74959]: INFO nova.compute.manager [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Terminating instance
Nov 28 23:05:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:19 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Instance destroyed successfully.
Nov 28 23:05:19 user nova-compute[74959]: DEBUG nova.objects.instance [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'resources' on Instance uuid 94b085b2-b298-4780-be94-21f85c799945 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1352161345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1352161345',id=5,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY4MPQnR0dTjucVmfRDrhSYKQ3fqU/FWP4ALTGw8zlVLwL32IGrGCUHF6lce73hXDH8jVHMwOZD1NSRvG/cdfElX8l2fYUZVksr8R+lEHe8XLHTG3jfGiDtzbAS3EBOcA==',key_name='tempest-keypair-271008495',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:03:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-oyejk6uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=94b085b2-b298-4780-be94-21f85c799945,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "address": "fa:16:3e:39:09:03", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60abc7f-b5", "ovs_interfaceid": "c60abc7f-b5c7-45ef-a218-d7454c7dbff8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG os_vif [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc60abc7f-b5, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=555632b5-622b-4fd4-9317-aaf4a590400b) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:19 user nova-compute[74959]: INFO os_vif [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:09:03,bridge_name='br-int',has_traffic_filtering=True,id=c60abc7f-b5c7-45ef-a218-d7454c7dbff8,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60abc7f-b5')
Nov 28 23:05:19 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Deleting instance files /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945_del
Nov 28 23:05:19 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Deletion of /opt/stack/data/nova/instances/94b085b2-b298-4780-be94-21f85c799945_del complete
Nov 28 23:05:19 user nova-compute[74959]: INFO nova.compute.manager [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: 94b085b2-b298-4780-be94-21f85c799945] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 23:05:19 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:05:19 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:05:20 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:20 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 94b085b2-b298-4780-be94-21f85c799945] Took 0.81 seconds to deallocate network for instance.
Nov 28 23:05:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-cb79f23f-fc88-4183-a2e5-112800cad427 req-5a836da0-7cbf-4c37-87ff-5a42bf8bc62d service nova] [instance: 94b085b2-b298-4780-be94-21f85c799945] Received event network-vif-deleted-c60abc7f-b5c7-45ef-a218-d7454c7dbff8 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:20 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:05:20 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:05:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:20 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Deleted allocations for instance 94b085b2-b298-4780-be94-21f85c799945
Nov 28 23:05:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-edfbc355-7562-4a82-b148-5ba4f76f966b tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "94b085b2-b298-4780-be94-21f85c799945" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.329s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:05:24 user nova-compute[74959]: INFO nova.compute.claims [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Claim successful on node user
Nov 28 23:05:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.network.neutron [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:05:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:05:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Creating image(s)
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "/opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "/opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG nova.policy [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08e192228fa94f08bf9c5173717e958e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b335c2c2384f1686152b556b992878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.210s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk 1073741824" returned: 0 in 0.063s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG nova.network.neutron [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Successfully created port: 53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Cannot resize image /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Ensure instance console log exists: /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Successfully updated port: 53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "refresh_cache-3fbcfd9e-bf33-4452-8a4f-8500ec54df51" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquired lock "refresh_cache-3fbcfd9e-bf33-4452-8a4f-8500ec54df51" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-545cb3e2-172d-4bc0-93bd-0e6d7a368929 req-cdb8bb09-cf8d-4eef-9da2-9319df87031c service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received event network-changed-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-545cb3e2-172d-4bc0-93bd-0e6d7a368929 req-cdb8bb09-cf8d-4eef-9da2-9319df87031c service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Refreshing instance network info cache due to event network-changed-53709c08-cf21-4a56-8d9d-1b069b887dea. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-545cb3e2-172d-4bc0-93bd-0e6d7a368929 req-cdb8bb09-cf8d-4eef-9da2-9319df87031c service nova] Acquiring lock "refresh_cache-3fbcfd9e-bf33-4452-8a4f-8500ec54df51" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:05:26 user nova-compute[74959]: INFO nova.compute.claims [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Claim successful on node user
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Updating instance_info_cache with network_info: [{"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Releasing lock "refresh_cache-3fbcfd9e-bf33-4452-8a4f-8500ec54df51" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Instance network_info: |[{"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-545cb3e2-172d-4bc0-93bd-0e6d7a368929 req-cdb8bb09-cf8d-4eef-9da2-9319df87031c service nova] Acquired lock "refresh_cache-3fbcfd9e-bf33-4452-8a4f-8500ec54df51" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-545cb3e2-172d-4bc0-93bd-0e6d7a368929 req-cdb8bb09-cf8d-4eef-9da2-9319df87031c service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Refreshing network info cache for port 53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Start _get_guest_xml network_info=[{"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:05:26 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:05:26 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2048993786',display_name='tempest-VolumesNegativeTest-instance-2048993786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2048993786',id=20,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65b335c2c2384f1686152b556b992878',ramdisk_id='',reservation_id='r-4iz5jr2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1273793192',owner_user_name='tempest-VolumesNegativeTest-1273793192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:05:25Z,user_data=None,user_id='08e192228fa94f08bf9c5173717e958e',uuid=3fbcfd9e-bf33-4452-8a4f-8500ec54df51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Converting VIF {"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=53709c08-cf21-4a56-8d9d-1b069b887dea,network=Network(374610b2-fd89-4df1-b002-b12e5e1b9438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53709c08-cf') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.objects.instance [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fbcfd9e-bf33-4452-8a4f-8500ec54df51 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:05:26 user nova-compute[74959]:   <uuid>3fbcfd9e-bf33-4452-8a4f-8500ec54df51</uuid>
Nov 28 23:05:26 user nova-compute[74959]:   <name>instance-00000014</name>
Nov 28 23:05:26 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:05:26 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:05:26 user nova-compute[74959]:   <metadata>
Nov 28 23:05:26 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:05:26 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:05:26 user nova-compute[74959]:       <nova:name>tempest-VolumesNegativeTest-instance-2048993786</nova:name>
Nov 28 23:05:26 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:05:26</nova:creationTime>
Nov 28 23:05:26 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:05:26 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:05:26 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:05:26 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:05:26 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:05:26 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:05:26 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:05:26 user nova-compute[74959]:       <nova:owner>
Nov 28 23:05:26 user nova-compute[74959]:         <nova:user uuid="08e192228fa94f08bf9c5173717e958e">tempest-VolumesNegativeTest-1273793192-project-member</nova:user>
Nov 28 23:05:26 user nova-compute[74959]:         <nova:project uuid="65b335c2c2384f1686152b556b992878">tempest-VolumesNegativeTest-1273793192</nova:project>
Nov 28 23:05:26 user nova-compute[74959]:       </nova:owner>
Nov 28 23:05:26 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:05:26 user nova-compute[74959]:       <nova:ports>
Nov 28 23:05:26 user nova-compute[74959]:         <nova:port uuid="53709c08-cf21-4a56-8d9d-1b069b887dea">
Nov 28 23:05:26 user nova-compute[74959]:           <nova:ip type="fixed" address="192.168.233.176" ipVersion="4"/>
Nov 28 23:05:26 user nova-compute[74959]:         </nova:port>
Nov 28 23:05:26 user nova-compute[74959]:       </nova:ports>
Nov 28 23:05:26 user nova-compute[74959]:     </nova:instance>
Nov 28 23:05:26 user nova-compute[74959]:   </metadata>
Nov 28 23:05:26 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:05:26 user nova-compute[74959]:     <system>
Nov 28 23:05:26 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:05:26 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:05:26 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:05:26 user nova-compute[74959]:       <entry name="serial">3fbcfd9e-bf33-4452-8a4f-8500ec54df51</entry>
Nov 28 23:05:26 user nova-compute[74959]:       <entry name="uuid">3fbcfd9e-bf33-4452-8a4f-8500ec54df51</entry>
Nov 28 23:05:26 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:05:26 user nova-compute[74959]:     </system>
Nov 28 23:05:26 user nova-compute[74959]:   </sysinfo>
Nov 28 23:05:26 user nova-compute[74959]:   <os>
Nov 28 23:05:26 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:05:26 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:05:26 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:05:26 user nova-compute[74959]:   </os>
Nov 28 23:05:26 user nova-compute[74959]:   <features>
Nov 28 23:05:26 user nova-compute[74959]:     <acpi/>
Nov 28 23:05:26 user nova-compute[74959]:     <apic/>
Nov 28 23:05:26 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:05:26 user nova-compute[74959]:   </features>
Nov 28 23:05:26 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:05:26 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:05:26 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:05:26 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:05:26 user nova-compute[74959]:   </clock>
Nov 28 23:05:26 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:05:26 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:05:26 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:05:26 user nova-compute[74959]:   </cpu>
Nov 28 23:05:26 user nova-compute[74959]:   <devices>
Nov 28 23:05:26 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:05:26 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:05:26 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk"/>
Nov 28 23:05:26 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:05:26 user nova-compute[74959]:     </disk>
Nov 28 23:05:26 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:05:26 user nova-compute[74959]:       <mac address="fa:16:3e:eb:2d:c1"/>
Nov 28 23:05:26 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:05:26 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:05:26 user nova-compute[74959]:       <target dev="tap53709c08-cf"/>
Nov 28 23:05:26 user nova-compute[74959]:     </interface>
Nov 28 23:05:26 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:05:26 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/console.log" append="off"/>
Nov 28 23:05:26 user nova-compute[74959]:     </serial>
Nov 28 23:05:26 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:05:26 user nova-compute[74959]:     <video>
Nov 28 23:05:26 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:05:26 user nova-compute[74959]:     </video>
Nov 28 23:05:26 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:05:26 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:05:26 user nova-compute[74959]:     </rng>
Nov 28 23:05:26 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:05:26 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:05:26 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:05:26 user nova-compute[74959]:     </memballoon>
Nov 28 23:05:26 user nova-compute[74959]:   </devices>
Nov 28 23:05:26 user nova-compute[74959]: </domain>
Nov 28 23:05:26 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2048993786',display_name='tempest-VolumesNegativeTest-instance-2048993786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2048993786',id=20,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65b335c2c2384f1686152b556b992878',ramdisk_id='',reservation_id='r-4iz5jr2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1273793192',owner_user_name='tempest-VolumesNegativeTest-1273793192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:05:25Z,user_data=None,user_id='08e192228fa94f08bf9c5173717e958e',uuid=3fbcfd9e-bf33-4452-8a4f-8500ec54df51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Converting VIF {"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=53709c08-cf21-4a56-8d9d-1b069b887dea,network=Network(374610b2-fd89-4df1-b002-b12e5e1b9438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53709c08-cf') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG os_vif [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=53709c08-cf21-4a56-8d9d-1b069b887dea,network=Network(374610b2-fd89-4df1-b002-b12e5e1b9438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53709c08-cf') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20633c40-5219-5fc9-8bce-572b98c5c821', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53709c08-cf, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53709c08-cf, col_values=(('qos', UUID('968c2917-6472-41c1-9e9d-e46db1c528d3')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53709c08-cf, col_values=(('external_ids', {'iface-id': '53709c08-cf21-4a56-8d9d-1b069b887dea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:2d:c1', 'vm-uuid': '3fbcfd9e-bf33-4452-8a4f-8500ec54df51'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:26 user nova-compute[74959]: INFO os_vif [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=53709c08-cf21-4a56-8d9d-1b069b887dea,network=Network(374610b2-fd89-4df1-b002-b12e5e1b9438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53709c08-cf')
Nov 28 23:05:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] No VIF found with MAC fa:16:3e:eb:2d:c1, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:05:26 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:05:26 user nova-compute[74959]: DEBUG nova.policy [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dd69e22dca14d07a72e497724aaebeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f3da93b47d4f969f058c6fd6867823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:05:27 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Creating image(s)
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "/opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "/opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-545cb3e2-172d-4bc0-93bd-0e6d7a368929 req-cdb8bb09-cf8d-4eef-9da2-9319df87031c service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Updated VIF entry in instance network info cache for port 53709c08-cf21-4a56-8d9d-1b069b887dea. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-545cb3e2-172d-4bc0-93bd-0e6d7a368929 req-cdb8bb09-cf8d-4eef-9da2-9319df87031c service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Updating instance_info_cache with network_info: [{"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-545cb3e2-172d-4bc0-93bd-0e6d7a368929 req-cdb8bb09-cf8d-4eef-9da2-9319df87031c service nova] Releasing lock "refresh_cache-3fbcfd9e-bf33-4452-8a4f-8500ec54df51" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk 1073741824" returned: 0 in 0.056s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.network.neutron [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Successfully created port: b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Cannot resize image /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Ensure instance console log exists: /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.neutron [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Successfully updated port: b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquired lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.neutron [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-d56459ce-f48d-4ae9-b2d9-092c3e40dadf req-2fe1fa57-0360-4bc6-b4de-8865ec4b1fce service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received event network-changed-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-d56459ce-f48d-4ae9-b2d9-092c3e40dadf req-2fe1fa57-0360-4bc6-b4de-8865ec4b1fce service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Refreshing instance network info cache due to event network-changed-b5cf4232-6f1a-4a52-bb84-151c4d04e12b. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d56459ce-f48d-4ae9-b2d9-092c3e40dadf req-2fe1fa57-0360-4bc6-b4de-8865ec4b1fce service nova] Acquiring lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.neutron [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-d2a206d2-e756-45c5-83f4-20edd8eafb18 req-95c607fc-6350-42e5-9d62-c32a812c01c4 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received event network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d2a206d2-e756-45c5-83f4-20edd8eafb18 req-95c607fc-6350-42e5-9d62-c32a812c01c4 service nova] Acquiring lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d2a206d2-e756-45c5-83f4-20edd8eafb18 req-95c607fc-6350-42e5-9d62-c32a812c01c4 service nova] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d2a206d2-e756-45c5-83f4-20edd8eafb18 req-95c607fc-6350-42e5-9d62-c32a812c01c4 service nova] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-d2a206d2-e756-45c5-83f4-20edd8eafb18 req-95c607fc-6350-42e5-9d62-c32a812c01c4 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] No waiting events found dispatching network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:28 user nova-compute[74959]: WARNING nova.compute.manager [req-d2a206d2-e756-45c5-83f4-20edd8eafb18 req-95c607fc-6350-42e5-9d62-c32a812c01c4 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received unexpected event network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea for instance with vm_state building and task_state spawning.
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.neutron [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Updating instance_info_cache with network_info: [{"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Releasing lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Instance network_info: |[{"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d56459ce-f48d-4ae9-b2d9-092c3e40dadf req-2fe1fa57-0360-4bc6-b4de-8865ec4b1fce service nova] Acquired lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.neutron [req-d56459ce-f48d-4ae9-b2d9-092c3e40dadf req-2fe1fa57-0360-4bc6-b4de-8865ec4b1fce service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Refreshing network info cache for port b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Start _get_guest_xml network_info=[{"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:05:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:05:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-169981963',display_name='tempest-TestServerVolumeAttachmentScenario-server-169981963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-169981963',id=21,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgK0eGXXI8cZ+BzSSVWQ9E23FrjuyLujL4qcokzSPF6gx97KGVcJBKOgYYfwftXNIgmAVpyyjNAjJguIxam8imLyDOnmqNXUR/pobQLhcmpDB2GKgc0wqggkh0tgqpIAQ==',key_name='tempest-keypair-1664512815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93f3da93b47d4f969f058c6fd6867823',ramdisk_id='',reservation_id='r-cvu8yvri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1475661741',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1475661741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:05:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dd69e22dca14d07a72e497724aaebeb',uuid=ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Converting VIF {"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=b5cf4232-6f1a-4a52-bb84-151c4d04e12b,network=Network(52c61db4-72b0-44ee-9979-db0dfe02bd15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5cf4232-6f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lazy-loading 'pci_devices' on Instance uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:05:28 user nova-compute[74959]:   <uuid>ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c</uuid>
Nov 28 23:05:28 user nova-compute[74959]:   <name>instance-00000015</name>
Nov 28 23:05:28 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:05:28 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:05:28 user nova-compute[74959]:   <metadata>
Nov 28 23:05:28 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:05:28 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:05:28 user nova-compute[74959]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-169981963</nova:name>
Nov 28 23:05:28 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:05:28</nova:creationTime>
Nov 28 23:05:28 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:05:28 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:05:28 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:05:28 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:05:28 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:05:28 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:05:28 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:05:28 user nova-compute[74959]:       <nova:owner>
Nov 28 23:05:28 user nova-compute[74959]:         <nova:user uuid="2dd69e22dca14d07a72e497724aaebeb">tempest-TestServerVolumeAttachmentScenario-1475661741-project-member</nova:user>
Nov 28 23:05:28 user nova-compute[74959]:         <nova:project uuid="93f3da93b47d4f969f058c6fd6867823">tempest-TestServerVolumeAttachmentScenario-1475661741</nova:project>
Nov 28 23:05:28 user nova-compute[74959]:       </nova:owner>
Nov 28 23:05:28 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:05:28 user nova-compute[74959]:       <nova:ports>
Nov 28 23:05:28 user nova-compute[74959]:         <nova:port uuid="b5cf4232-6f1a-4a52-bb84-151c4d04e12b">
Nov 28 23:05:28 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 23:05:28 user nova-compute[74959]:         </nova:port>
Nov 28 23:05:28 user nova-compute[74959]:       </nova:ports>
Nov 28 23:05:28 user nova-compute[74959]:     </nova:instance>
Nov 28 23:05:28 user nova-compute[74959]:   </metadata>
Nov 28 23:05:28 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:05:28 user nova-compute[74959]:     <system>
Nov 28 23:05:28 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:05:28 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:05:28 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:05:28 user nova-compute[74959]:       <entry name="serial">ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c</entry>
Nov 28 23:05:28 user nova-compute[74959]:       <entry name="uuid">ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c</entry>
Nov 28 23:05:28 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:05:28 user nova-compute[74959]:     </system>
Nov 28 23:05:28 user nova-compute[74959]:   </sysinfo>
Nov 28 23:05:28 user nova-compute[74959]:   <os>
Nov 28 23:05:28 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:05:28 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:05:28 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:05:28 user nova-compute[74959]:   </os>
Nov 28 23:05:28 user nova-compute[74959]:   <features>
Nov 28 23:05:28 user nova-compute[74959]:     <acpi/>
Nov 28 23:05:28 user nova-compute[74959]:     <apic/>
Nov 28 23:05:28 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:05:28 user nova-compute[74959]:   </features>
Nov 28 23:05:28 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:05:28 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:05:28 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:05:28 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:05:28 user nova-compute[74959]:   </clock>
Nov 28 23:05:28 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:05:28 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:05:28 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:05:28 user nova-compute[74959]:   </cpu>
Nov 28 23:05:28 user nova-compute[74959]:   <devices>
Nov 28 23:05:28 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:05:28 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:05:28 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk"/>
Nov 28 23:05:28 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:05:28 user nova-compute[74959]:     </disk>
Nov 28 23:05:28 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:05:28 user nova-compute[74959]:       <mac address="fa:16:3e:f3:22:ee"/>
Nov 28 23:05:28 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:05:28 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:05:28 user nova-compute[74959]:       <target dev="tapb5cf4232-6f"/>
Nov 28 23:05:28 user nova-compute[74959]:     </interface>
Nov 28 23:05:28 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:05:28 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/console.log" append="off"/>
Nov 28 23:05:28 user nova-compute[74959]:     </serial>
Nov 28 23:05:28 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:05:28 user nova-compute[74959]:     <video>
Nov 28 23:05:28 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:05:28 user nova-compute[74959]:     </video>
Nov 28 23:05:28 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:05:28 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:05:28 user nova-compute[74959]:     </rng>
Nov 28 23:05:28 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:05:28 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:05:28 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:05:28 user nova-compute[74959]:     </memballoon>
Nov 28 23:05:28 user nova-compute[74959]:   </devices>
Nov 28 23:05:28 user nova-compute[74959]: </domain>
Nov 28 23:05:28 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-169981963',display_name='tempest-TestServerVolumeAttachmentScenario-server-169981963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-169981963',id=21,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgK0eGXXI8cZ+BzSSVWQ9E23FrjuyLujL4qcokzSPF6gx97KGVcJBKOgYYfwftXNIgmAVpyyjNAjJguIxam8imLyDOnmqNXUR/pobQLhcmpDB2GKgc0wqggkh0tgqpIAQ==',key_name='tempest-keypair-1664512815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93f3da93b47d4f969f058c6fd6867823',ramdisk_id='',reservation_id='r-cvu8yvri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1475661741',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1475661741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:05:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dd69e22dca14d07a72e497724aaebeb',uuid=ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Converting VIF {"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=b5cf4232-6f1a-4a52-bb84-151c4d04e12b,network=Network(52c61db4-72b0-44ee-9979-db0dfe02bd15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5cf4232-6f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG os_vif [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=b5cf4232-6f1a-4a52-bb84-151c4d04e12b,network=Network(52c61db4-72b0-44ee-9979-db0dfe02bd15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5cf4232-6f') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d18750d-26c8-5e4c-bee2-5c9bc2da0ad4', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5cf4232-6f, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5cf4232-6f, col_values=(('qos', UUID('f7620d96-3f54-4d9c-b24a-20570a8865b4')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5cf4232-6f, col_values=(('external_ids', {'iface-id': 'b5cf4232-6f1a-4a52-bb84-151c4d04e12b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:22:ee', 'vm-uuid': 'ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: INFO os_vif [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=b5cf4232-6f1a-4a52-bb84-151c4d04e12b,network=Network(52c61db4-72b0-44ee-9979-db0dfe02bd15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5cf4232-6f')
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No VIF found with MAC fa:16:3e:f3:22:ee, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:05:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:29 user nova-compute[74959]: DEBUG nova.network.neutron [req-d56459ce-f48d-4ae9-b2d9-092c3e40dadf req-2fe1fa57-0360-4bc6-b4de-8865ec4b1fce service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Updated VIF entry in instance network info cache for port b5cf4232-6f1a-4a52-bb84-151c4d04e12b. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:05:29 user nova-compute[74959]: DEBUG nova.network.neutron [req-d56459ce-f48d-4ae9-b2d9-092c3e40dadf req-2fe1fa57-0360-4bc6-b4de-8865ec4b1fce service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Updating instance_info_cache with network_info: [{"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d56459ce-f48d-4ae9-b2d9-092c3e40dadf req-2fe1fa57-0360-4bc6-b4de-8865ec4b1fce service nova] Releasing lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-b394390c-1fd9-406a-a5d0-7e65ad4dec74 req-854d0c22-606b-47c1-b1db-2f52314b3451 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received event network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b394390c-1fd9-406a-a5d0-7e65ad4dec74 req-854d0c22-606b-47c1-b1db-2f52314b3451 service nova] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b394390c-1fd9-406a-a5d0-7e65ad4dec74 req-854d0c22-606b-47c1-b1db-2f52314b3451 service nova] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b394390c-1fd9-406a-a5d0-7e65ad4dec74 req-854d0c22-606b-47c1-b1db-2f52314b3451 service nova] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-b394390c-1fd9-406a-a5d0-7e65ad4dec74 req-854d0c22-606b-47c1-b1db-2f52314b3451 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] No waiting events found dispatching network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:30 user nova-compute[74959]: WARNING nova.compute.manager [req-b394390c-1fd9-406a-a5d0-7e65ad4dec74 req-854d0c22-606b-47c1-b1db-2f52314b3451 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received unexpected event network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b for instance with vm_state building and task_state spawning.
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:05:30 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Instance spawned successfully.
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-7937408c-9b22-47c6-9f40-0d40ff576296 req-8daa5960-31eb-4af1-a790-790a2abead47 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received event network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7937408c-9b22-47c6-9f40-0d40ff576296 req-8daa5960-31eb-4af1-a790-790a2abead47 service nova] Acquiring lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7937408c-9b22-47c6-9f40-0d40ff576296 req-8daa5960-31eb-4af1-a790-790a2abead47 service nova] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7937408c-9b22-47c6-9f40-0d40ff576296 req-8daa5960-31eb-4af1-a790-790a2abead47 service nova] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-7937408c-9b22-47c6-9f40-0d40ff576296 req-8daa5960-31eb-4af1-a790-790a2abead47 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] No waiting events found dispatching network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:30 user nova-compute[74959]: WARNING nova.compute.manager [req-7937408c-9b22-47c6-9f40-0d40ff576296 req-8daa5960-31eb-4af1-a790-790a2abead47 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received unexpected event network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea for instance with vm_state building and task_state spawning.
Nov 28 23:05:30 user nova-compute[74959]: INFO nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 28 23:05:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:05:30 user nova-compute[74959]: INFO nova.compute.manager [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Took 6.57 seconds to build instance.
Nov 28 23:05:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14a98744-0cb6-45b1-b446-55ac4508f029 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.682s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:05:32 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Instance spawned successfully.
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-1a97fa82-2664-4485-a4a0-1a6b8161f84f req-1dc375b4-ec55-44c9-9f85-90db38b896cd service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received event network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1a97fa82-2664-4485-a4a0-1a6b8161f84f req-1dc375b4-ec55-44c9-9f85-90db38b896cd service nova] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1a97fa82-2664-4485-a4a0-1a6b8161f84f req-1dc375b4-ec55-44c9-9f85-90db38b896cd service nova] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1a97fa82-2664-4485-a4a0-1a6b8161f84f req-1dc375b4-ec55-44c9-9f85-90db38b896cd service nova] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-1a97fa82-2664-4485-a4a0-1a6b8161f84f req-1dc375b4-ec55-44c9-9f85-90db38b896cd service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] No waiting events found dispatching network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:32 user nova-compute[74959]: WARNING nova.compute.manager [req-1a97fa82-2664-4485-a4a0-1a6b8161f84f req-1dc375b4-ec55-44c9-9f85-90db38b896cd service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received unexpected event network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b for instance with vm_state building and task_state spawning.
Nov 28 23:05:32 user nova-compute[74959]: INFO nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 28 23:05:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:05:32 user nova-compute[74959]: INFO nova.compute.manager [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Took 6.28 seconds to build instance.
Nov 28 23:05:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-992074c0-82bf-4d2a-8c7e-c342135ffd91 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.409s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:05:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:05:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:05:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:05:35 user nova-compute[74959]: INFO nova.compute.claims [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Claim successful on node user
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.network.neutron [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:05:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.policy [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f0d2814e7e4df6904596bc07befe0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c57e434911c407189c1801142c226e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:05:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Creating image(s)
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "/opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "/opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.209s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk 1073741824" returned: 0 in 0.064s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Successfully created port: aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Cannot resize image /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Ensure instance console log exists: /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Successfully updated port: aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquired lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-15ff3ccd-ac5c-4554-8b65-03bd1afaa19a req-a8f8163e-5acd-4a81-8ff9-54234ed33df4 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received event network-changed-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-15ff3ccd-ac5c-4554-8b65-03bd1afaa19a req-a8f8163e-5acd-4a81-8ff9-54234ed33df4 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Refreshing instance network info cache due to event network-changed-aa7ad87d-15ef-4ede-8291-2a244cded2b5. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15ff3ccd-ac5c-4554-8b65-03bd1afaa19a req-a8f8163e-5acd-4a81-8ff9-54234ed33df4 service nova] Acquiring lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:05:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Updating instance_info_cache with network_info: [{"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Releasing lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Instance network_info: |[{"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15ff3ccd-ac5c-4554-8b65-03bd1afaa19a req-a8f8163e-5acd-4a81-8ff9-54234ed33df4 service nova] Acquired lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-15ff3ccd-ac5c-4554-8b65-03bd1afaa19a req-a8f8163e-5acd-4a81-8ff9-54234ed33df4 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Refreshing network info cache for port aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Start _get_guest_xml network_info=[{"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:05:38 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:05:38 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1706804855',display_name='tempest-AttachVolumeNegativeTest-server-1706804855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1706804855',id=22,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD87G8a6eHCP+qf1Q47htpxgu9sXeGIPNUCvZpiNB0qgUXmYH8xuOmYM5FOQqEMU91mjSaHW1BHRubxiHt+o6Whx10EmF17gI3h2IhfD0yXAZwVgeReLcKUIZGDy69qMSQ==',key_name='tempest-keypair-318752727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-94p8lhkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=7d4ca972-77ec-4a5c-8259-b695fba4b862,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:15:36,bridge_name='br-int',has_traffic_filtering=True,id=aa7ad87d-15ef-4ede-8291-2a244cded2b5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7ad87d-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.objects.instance [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d4ca972-77ec-4a5c-8259-b695fba4b862 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:05:38 user nova-compute[74959]:   <uuid>7d4ca972-77ec-4a5c-8259-b695fba4b862</uuid>
Nov 28 23:05:38 user nova-compute[74959]:   <name>instance-00000016</name>
Nov 28 23:05:38 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:05:38 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:05:38 user nova-compute[74959]:   <metadata>
Nov 28 23:05:38 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:05:38 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:05:38 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1706804855</nova:name>
Nov 28 23:05:38 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:05:38</nova:creationTime>
Nov 28 23:05:38 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:05:38 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:05:38 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:05:38 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:05:38 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:05:38 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:05:38 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:05:38 user nova-compute[74959]:       <nova:owner>
Nov 28 23:05:38 user nova-compute[74959]:         <nova:user uuid="11f0d2814e7e4df6904596bc07befe0e">tempest-AttachVolumeNegativeTest-1174707224-project-member</nova:user>
Nov 28 23:05:38 user nova-compute[74959]:         <nova:project uuid="1c57e434911c407189c1801142c226e1">tempest-AttachVolumeNegativeTest-1174707224</nova:project>
Nov 28 23:05:38 user nova-compute[74959]:       </nova:owner>
Nov 28 23:05:38 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:05:38 user nova-compute[74959]:       <nova:ports>
Nov 28 23:05:38 user nova-compute[74959]:         <nova:port uuid="aa7ad87d-15ef-4ede-8291-2a244cded2b5">
Nov 28 23:05:38 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 23:05:38 user nova-compute[74959]:         </nova:port>
Nov 28 23:05:38 user nova-compute[74959]:       </nova:ports>
Nov 28 23:05:38 user nova-compute[74959]:     </nova:instance>
Nov 28 23:05:38 user nova-compute[74959]:   </metadata>
Nov 28 23:05:38 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:05:38 user nova-compute[74959]:     <system>
Nov 28 23:05:38 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:05:38 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:05:38 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:05:38 user nova-compute[74959]:       <entry name="serial">7d4ca972-77ec-4a5c-8259-b695fba4b862</entry>
Nov 28 23:05:38 user nova-compute[74959]:       <entry name="uuid">7d4ca972-77ec-4a5c-8259-b695fba4b862</entry>
Nov 28 23:05:38 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:05:38 user nova-compute[74959]:     </system>
Nov 28 23:05:38 user nova-compute[74959]:   </sysinfo>
Nov 28 23:05:38 user nova-compute[74959]:   <os>
Nov 28 23:05:38 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:05:38 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:05:38 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:05:38 user nova-compute[74959]:   </os>
Nov 28 23:05:38 user nova-compute[74959]:   <features>
Nov 28 23:05:38 user nova-compute[74959]:     <acpi/>
Nov 28 23:05:38 user nova-compute[74959]:     <apic/>
Nov 28 23:05:38 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:05:38 user nova-compute[74959]:   </features>
Nov 28 23:05:38 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:05:38 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:05:38 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:05:38 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:05:38 user nova-compute[74959]:   </clock>
Nov 28 23:05:38 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:05:38 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:05:38 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:05:38 user nova-compute[74959]:   </cpu>
Nov 28 23:05:38 user nova-compute[74959]:   <devices>
Nov 28 23:05:38 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:05:38 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:05:38 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk"/>
Nov 28 23:05:38 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:05:38 user nova-compute[74959]:     </disk>
Nov 28 23:05:38 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:05:38 user nova-compute[74959]:       <mac address="fa:16:3e:d7:15:36"/>
Nov 28 23:05:38 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:05:38 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:05:38 user nova-compute[74959]:       <target dev="tapaa7ad87d-15"/>
Nov 28 23:05:38 user nova-compute[74959]:     </interface>
Nov 28 23:05:38 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:05:38 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/console.log" append="off"/>
Nov 28 23:05:38 user nova-compute[74959]:     </serial>
Nov 28 23:05:38 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:05:38 user nova-compute[74959]:     <video>
Nov 28 23:05:38 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:05:38 user nova-compute[74959]:     </video>
Nov 28 23:05:38 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:05:38 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:05:38 user nova-compute[74959]:     </rng>
Nov 28 23:05:38 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:05:38 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:05:38 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:05:38 user nova-compute[74959]:     </memballoon>
Nov 28 23:05:38 user nova-compute[74959]:   </devices>
Nov 28 23:05:38 user nova-compute[74959]: </domain>
Nov 28 23:05:38 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1706804855',display_name='tempest-AttachVolumeNegativeTest-server-1706804855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1706804855',id=22,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD87G8a6eHCP+qf1Q47htpxgu9sXeGIPNUCvZpiNB0qgUXmYH8xuOmYM5FOQqEMU91mjSaHW1BHRubxiHt+o6Whx10EmF17gI3h2IhfD0yXAZwVgeReLcKUIZGDy69qMSQ==',key_name='tempest-keypair-318752727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-94p8lhkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=7d4ca972-77ec-4a5c-8259-b695fba4b862,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:15:36,bridge_name='br-int',has_traffic_filtering=True,id=aa7ad87d-15ef-4ede-8291-2a244cded2b5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7ad87d-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG os_vif [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:15:36,bridge_name='br-int',has_traffic_filtering=True,id=aa7ad87d-15ef-4ede-8291-2a244cded2b5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7ad87d-15') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17bdb031-5329-5771-89de-3fd9110d4c78', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:38 user nova-compute[74959]: WARNING nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid e1174ec3-4ec5-4538-b304-60c76ec41bc8 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid b3e1c6ff-87c8-48e7-8f05-693d26138bf5 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 3fbcfd9e-bf33-4452-8a4f-8500ec54df51 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 7d4ca972-77ec-4a5c-8259-b695fba4b862 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "e245a015-fc98-4557-8168-5089c3746e79" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa7ad87d-15, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa7ad87d-15, col_values=(('qos', UUID('b9d60042-011d-4d1d-8d12-7ae424a809b6')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa7ad87d-15, col_values=(('external_ids', {'iface-id': 'aa7ad87d-15ef-4ede-8291-2a244cded2b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:15:36', 'vm-uuid': '7d4ca972-77ec-4a5c-8259-b695fba4b862'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:38 user nova-compute[74959]: INFO os_vif [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:15:36,bridge_name='br-int',has_traffic_filtering=True,id=aa7ad87d-15ef-4ede-8291-2a244cded2b5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7ad87d-15')
Nov 28 23:05:38 user nova-compute[74959]: WARNING oslo_messaging._drivers.amqpdriver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.166s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.170s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.199s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No VIF found with MAC fa:16:3e:d7:15:36, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "e245a015-fc98-4557-8168-5089c3746e79" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.208s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.217s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.220s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-15ff3ccd-ac5c-4554-8b65-03bd1afaa19a req-a8f8163e-5acd-4a81-8ff9-54234ed33df4 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Updated VIF entry in instance network info cache for port aa7ad87d-15ef-4ede-8291-2a244cded2b5. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-15ff3ccd-ac5c-4554-8b65-03bd1afaa19a req-a8f8163e-5acd-4a81-8ff9-54234ed33df4 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Updating instance_info_cache with network_info: [{"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15ff3ccd-ac5c-4554-8b65-03bd1afaa19a req-a8f8163e-5acd-4a81-8ff9-54234ed33df4 service nova] Releasing lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ac3ca35-c904-4bbf-956a-6673a23dcf95 req-7fa45053-d8ca-4c83-a949-f9a347b09e3e service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received event network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ac3ca35-c904-4bbf-956a-6673a23dcf95 req-7fa45053-d8ca-4c83-a949-f9a347b09e3e service nova] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ac3ca35-c904-4bbf-956a-6673a23dcf95 req-7fa45053-d8ca-4c83-a949-f9a347b09e3e service nova] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ac3ca35-c904-4bbf-956a-6673a23dcf95 req-7fa45053-d8ca-4c83-a949-f9a347b09e3e service nova] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ac3ca35-c904-4bbf-956a-6673a23dcf95 req-7fa45053-d8ca-4c83-a949-f9a347b09e3e service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] No waiting events found dispatching network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:40 user nova-compute[74959]: WARNING nova.compute.manager [req-4ac3ca35-c904-4bbf-956a-6673a23dcf95 req-7fa45053-d8ca-4c83-a949-f9a347b09e3e service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received unexpected event network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 for instance with vm_state building and task_state spawning.
Nov 28 23:05:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:05:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Instance spawned successfully.
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ae7e130-22e2-4e77-b778-de3e77d28e7f req-3f1d3024-a322-44c4-bd43-a222e0af810c service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received event network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ae7e130-22e2-4e77-b778-de3e77d28e7f req-3f1d3024-a322-44c4-bd43-a222e0af810c service nova] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ae7e130-22e2-4e77-b778-de3e77d28e7f req-3f1d3024-a322-44c4-bd43-a222e0af810c service nova] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ae7e130-22e2-4e77-b778-de3e77d28e7f req-3f1d3024-a322-44c4-bd43-a222e0af810c service nova] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ae7e130-22e2-4e77-b778-de3e77d28e7f req-3f1d3024-a322-44c4-bd43-a222e0af810c service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] No waiting events found dispatching network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:42 user nova-compute[74959]: WARNING nova.compute.manager [req-4ae7e130-22e2-4e77-b778-de3e77d28e7f req-3f1d3024-a322-44c4-bd43-a222e0af810c service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received unexpected event network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 for instance with vm_state building and task_state spawning.
Nov 28 23:05:42 user nova-compute[74959]: INFO nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:42 user nova-compute[74959]: INFO nova.compute.manager [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Took 6.35 seconds to build instance.
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02c6d687-832b-411b-9512-b3d94c8d686d tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.461s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.904s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:42 user nova-compute[74959]: INFO nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:05:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:46 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:05:46 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7358MB free_disk=25.39886474609375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e1174ec3-4ec5-4538-b304-60c76ec41bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b3e1c6ff-87c8-48e7-8f05-693d26138bf5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 3fbcfd9e-bf33-4452-8a4f-8500ec54df51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:05:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:05:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:05:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-e07b514c-1975-4778-9d56-7501e10265c9 req-4c93db51-f638-466a-a474-5768235273f2 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-changed-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-e07b514c-1975-4778-9d56-7501e10265c9 req-4c93db51-f638-466a-a474-5768235273f2 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Refreshing instance network info cache due to event network-changed-5ced9d93-efc5-4031-8356-265e81b5884f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:05:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e07b514c-1975-4778-9d56-7501e10265c9 req-4c93db51-f638-466a-a474-5768235273f2 service nova] Acquiring lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:05:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e07b514c-1975-4778-9d56-7501e10265c9 req-4c93db51-f638-466a-a474-5768235273f2 service nova] Acquired lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:05:50 user nova-compute[74959]: DEBUG nova.network.neutron [req-e07b514c-1975-4778-9d56-7501e10265c9 req-4c93db51-f638-466a-a474-5768235273f2 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Refreshing network info cache for port 5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:05:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:51 user nova-compute[74959]: DEBUG nova.network.neutron [req-e07b514c-1975-4778-9d56-7501e10265c9 req-4c93db51-f638-466a-a474-5768235273f2 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updated VIF entry in instance network info cache for port 5ced9d93-efc5-4031-8356-265e81b5884f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:05:51 user nova-compute[74959]: DEBUG nova.network.neutron [req-e07b514c-1975-4778-9d56-7501e10265c9 req-4c93db51-f638-466a-a474-5768235273f2 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updating instance_info_cache with network_info: [{"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e07b514c-1975-4778-9d56-7501e10265c9 req-4c93db51-f638-466a-a474-5768235273f2 service nova] Releasing lock "refresh_cache-e1174ec3-4ec5-4538-b304-60c76ec41bc8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:05:51 user nova-compute[74959]: INFO nova.compute.manager [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Rebuilding instance
Nov 28 23:05:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:05:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-57c2e87e-3015-456e-811b-7be41e0ea6cf req-39167fc5-b971-46e1-a147-6dada1e24012 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-unplugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-57c2e87e-3015-456e-811b-7be41e0ea6cf req-39167fc5-b971-46e1-a147-6dada1e24012 service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-57c2e87e-3015-456e-811b-7be41e0ea6cf req-39167fc5-b971-46e1-a147-6dada1e24012 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-57c2e87e-3015-456e-811b-7be41e0ea6cf req-39167fc5-b971-46e1-a147-6dada1e24012 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-57c2e87e-3015-456e-811b-7be41e0ea6cf req-39167fc5-b971-46e1-a147-6dada1e24012 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] No waiting events found dispatching network-vif-unplugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:05:52 user nova-compute[74959]: WARNING nova.compute.manager [req-57c2e87e-3015-456e-811b-7be41e0ea6cf req-39167fc5-b971-46e1-a147-6dada1e24012 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received unexpected event network-vif-unplugged-5ced9d93-efc5-4031-8356-265e81b5884f for instance with vm_state active and task_state rebuilding.
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance destroyed successfully.
Nov 28 23:05:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance destroyed successfully.
Nov 28 23:05:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-89980862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1082676943',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqlpUARw/Tw9Nep95ScVmpCyPLJQOmSxAF1Y8ckwlsqtwT3jkaO4sDEsT0fDyaLML9r92WMny0erSsnO6MqU3oYNLrvO04b6VpEa5izHmhsvTDkh8uyrgG5eXNd00UpqQ==',key_name='tempest-keypair-1243684358',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40c538561f8446748937abce99e7eddf',ramdisk_id='',reservation_id='r-psdni240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-95008496',owner_user_name='tempest-ServerActionsV293TestJSON-95008496-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a20b8445a0a744588f59526545b4bc95',uuid=e1174ec3-4ec5-4538-b304-60c76ec41bc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converting VIF {"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_vif [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ced9d93-ef, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64272478-a30b-4638-b4f2-994ee5908845) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:52 user nova-compute[74959]: INFO os_vif [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef')
Nov 28 23:05:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:05:52 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c02613-3ae2-4a0d-880d-00ba7847bf2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:05:52 user nova-compute[74959]: No targets found.
Nov 28 23:05:52 user nova-compute[74959]: iSNS:
Nov 28 23:05:52 user nova-compute[74959]: No targets found.
Nov 28 23:05:52 user nova-compute[74959]: STATIC:
Nov 28 23:05:52 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:05:52 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:52 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:52 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6
Nov 28 23:05:52 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:52 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:52 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:05:52 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:52 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:52 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa
Nov 28 23:05:52 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:52 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:52 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9
Nov 28 23:05:52 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:52 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:52 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:05:52 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:52 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:52 user nova-compute[74959]: FIRMWARE:
Nov 28 23:05:52 user nova-compute[74959]: No targets found.
Nov 28 23:05:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:05:52 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:05:52 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d10e2-78e0-4878-a43b-b35a5f81c33c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ad4383-5ceb-48f8-b01a-2bd09b6b9074]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:05:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:05:52 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:05:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4741870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f'): ({'sdg'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Removing single pathed devices sdg {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ff9ac-698a-449c-910a-f95baada988a]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[59713291-3428-4871-b15a-ba6c11d68ff4]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Flushing IO for device /dev/sdg {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2d3271-2f46-4b3f-b593-76c60b1dd62b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb072dd-15dd-43f6-b1c0-a56fa8ae2807]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf25754d1-b78e3be6f0c84cf7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f25754d1', '/dev/disk/by-id/scsi-26237386533626536') {{(pid=86637) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8388e68e-fcad-41a6-824f-c7c32c03ebd1]: (4, None) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5ef6de-f67b-43fe-89ed-79e54d70cfa4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:05:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ae470-7463-487e-8b71-d617a2be11d2]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260]
Nov 28 23:05:53 user nova-compute[74959]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260] successful.
Nov 28 23:05:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[36475c70-eb12-4ff8-833d-470bfaa8b5b5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] <== disconnect_volume: return (364ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:05:53 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Deleting instance files /opt/stack/data/nova/instances/e1174ec3-4ec5-4538-b304-60c76ec41bc8_del
Nov 28 23:05:53 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Deletion of /opt/stack/data/nova/instances/e1174ec3-4ec5-4538-b304-60c76ec41bc8_del complete
Nov 28 23:05:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e1174ec3-4ec5-4538-b304-60c76ec41bc8 could not be found.
Nov 28 23:05:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:05:53 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[90604f79-ebf5-4510-9716-0b723949c3bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:05:53 user nova-compute[74959]: No targets found.
Nov 28 23:05:53 user nova-compute[74959]: iSNS:
Nov 28 23:05:53 user nova-compute[74959]: No targets found.
Nov 28 23:05:53 user nova-compute[74959]: STATIC:
Nov 28 23:05:53 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:05:53 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:53 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:53 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6
Nov 28 23:05:53 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:53 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:53 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:05:53 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:53 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:53 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa
Nov 28 23:05:53 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:53 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:53 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9
Nov 28 23:05:53 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:05:53 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:05:53 user nova-compute[74959]: FIRMWARE:
Nov 28 23:05:53 user nova-compute[74959]: No targets found.
Nov 28 23:05:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:05:53 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:05:53 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[959fd790-b4db-4968-9b14-53985ac69e55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[815f4d17-630e-4b37-b4da-5e4eefdf1653]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:05:53 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:05:53 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:05:53 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:05:53 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:05:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:05:53 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:05:53 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:05:53 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:05:53 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:05:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef464fc70>, {}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Disconnecting from: [] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] <== disconnect_volume: return (82ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:05:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Preparing to wait for external event volume-reimaged-858e5775-3686-4c19-b158-a2019e464c3f {{(pid=74959) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-8f641fd3-7518-4c19-9626-95a6ca80296d req-ca8601a7-c793-4e44-b9d4-f7257f84ae72 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8f641fd3-7518-4c19-9626-95a6ca80296d req-ca8601a7-c793-4e44-b9d4-f7257f84ae72 service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8f641fd3-7518-4c19-9626-95a6ca80296d req-ca8601a7-c793-4e44-b9d4-f7257f84ae72 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8f641fd3-7518-4c19-9626-95a6ca80296d req-ca8601a7-c793-4e44-b9d4-f7257f84ae72 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:05:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-8f641fd3-7518-4c19-9626-95a6ca80296d req-ca8601a7-c793-4e44-b9d4-f7257f84ae72 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] No event matching network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f in dict_keys([('volume-reimaged', '858e5775-3686-4c19-b158-a2019e464c3f')]) {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 28 23:05:54 user nova-compute[74959]: WARNING nova.compute.manager [req-8f641fd3-7518-4c19-9626-95a6ca80296d req-ca8601a7-c793-4e44-b9d4-f7257f84ae72 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received unexpected event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f for instance with vm_state active and task_state rebuilding.
Nov 28 23:05:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:05:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-883ab67b-d32f-4d36-8528-4632bf691da0 req-7308f748-c251-4f8b-ba33-5da014843a63 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-changed-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:05:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-883ab67b-d32f-4d36-8528-4632bf691da0 req-7308f748-c251-4f8b-ba33-5da014843a63 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing instance network info cache due to event network-changed-5f0717ec-fb17-491c-9652-75a0a2634da9. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:05:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-883ab67b-d32f-4d36-8528-4632bf691da0 req-7308f748-c251-4f8b-ba33-5da014843a63 service nova] Acquiring lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:05:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-883ab67b-d32f-4d36-8528-4632bf691da0 req-7308f748-c251-4f8b-ba33-5da014843a63 service nova] Acquired lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:05:57 user nova-compute[74959]: DEBUG nova.network.neutron [req-883ab67b-d32f-4d36-8528-4632bf691da0 req-7308f748-c251-4f8b-ba33-5da014843a63 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Refreshing network info cache for port 5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:05:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-883ab67b-d32f-4d36-8528-4632bf691da0 req-7308f748-c251-4f8b-ba33-5da014843a63 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updated VIF entry in instance network info cache for port 5f0717ec-fb17-491c-9652-75a0a2634da9. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:05:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-883ab67b-d32f-4d36-8528-4632bf691da0 req-7308f748-c251-4f8b-ba33-5da014843a63 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:05:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-883ab67b-d32f-4d36-8528-4632bf691da0 req-7308f748-c251-4f8b-ba33-5da014843a63 service nova] Releasing lock "refresh_cache-b3e1c6ff-87c8-48e7-8f05-693d26138bf5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:05:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:00 user nova-compute[74959]: INFO nova.compute.manager [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Terminating instance
Nov 28 23:06:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-d6853b5a-a534-460d-9bad-93817d7044ff req-37483bac-0573-46bd-9b12-ba0e4555a60e service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d6853b5a-a534-460d-9bad-93817d7044ff req-37483bac-0573-46bd-9b12-ba0e4555a60e service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d6853b5a-a534-460d-9bad-93817d7044ff req-37483bac-0573-46bd-9b12-ba0e4555a60e service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d6853b5a-a534-460d-9bad-93817d7044ff req-37483bac-0573-46bd-9b12-ba0e4555a60e service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-d6853b5a-a534-460d-9bad-93817d7044ff req-37483bac-0573-46bd-9b12-ba0e4555a60e service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-unplugged-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-d6853b5a-a534-460d-9bad-93817d7044ff req-37483bac-0573-46bd-9b12-ba0e4555a60e service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-5f0717ec-fb17-491c-9652-75a0a2634da9 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-2b7a5d7d-9ccd-4673-89fc-53331707d40d req-31955af0-eacb-4262-bac1-7804dd859e90 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2b7a5d7d-9ccd-4673-89fc-53331707d40d req-31955af0-eacb-4262-bac1-7804dd859e90 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2b7a5d7d-9ccd-4673-89fc-53331707d40d req-31955af0-eacb-4262-bac1-7804dd859e90 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2b7a5d7d-9ccd-4673-89fc-53331707d40d req-31955af0-eacb-4262-bac1-7804dd859e90 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-2b7a5d7d-9ccd-4673-89fc-53331707d40d req-31955af0-eacb-4262-bac1-7804dd859e90 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-unplugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-2b7a5d7d-9ccd-4673-89fc-53331707d40d req-31955af0-eacb-4262-bac1-7804dd859e90 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-76f5554d-7db2-4fd6-a90a-c19f0f1f9701 req-773132c9-9ef3-432c-8729-a1fd85f16afc service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-76f5554d-7db2-4fd6-a90a-c19f0f1f9701 req-773132c9-9ef3-432c-8729-a1fd85f16afc service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-76f5554d-7db2-4fd6-a90a-c19f0f1f9701 req-773132c9-9ef3-432c-8729-a1fd85f16afc service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-76f5554d-7db2-4fd6-a90a-c19f0f1f9701 req-773132c9-9ef3-432c-8729-a1fd85f16afc service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-76f5554d-7db2-4fd6-a90a-c19f0f1f9701 req-773132c9-9ef3-432c-8729-a1fd85f16afc service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-unplugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-76f5554d-7db2-4fd6-a90a-c19f0f1f9701 req-773132c9-9ef3-432c-8729-a1fd85f16afc service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: INFO nova.compute.manager [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Rescuing
Nov 28 23:06:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquired lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Instance destroyed successfully.
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lazy-loading 'resources' on Instance uuid b3e1c6ff-87c8-48e7-8f05-693d26138bf5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:59:9a,bridge_name='br-int',has_traffic_filtering=True,id=5f0717ec-fb17-491c-9652-75a0a2634da9,network=Network(e7c3c1e8-81cd-4480-bbee-6669822795e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f0717ec-fb') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:59:9a,bridge_name='br-int',has_traffic_filtering=True,id=5f0717ec-fb17-491c-9652-75a0a2634da9,network=Network(e7c3c1e8-81cd-4480-bbee-6669822795e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f0717ec-fb') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f0717ec-fb, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edebc04d-c7c3-47f3-820d-6a4b9fb9c216) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: INFO os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:59:9a,bridge_name='br-int',has_traffic_filtering=True,id=5f0717ec-fb17-491c-9652-75a0a2634da9,network=Network(e7c3c1e8-81cd-4480-bbee-6669822795e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f0717ec-fb')
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:e9:4d,bridge_name='br-int',has_traffic_filtering=True,id=f1e08bcc-68c7-4755-80ea-ce3a8c134f7c,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1e08bcc-68') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:e9:4d,bridge_name='br-int',has_traffic_filtering=True,id=f1e08bcc-68c7-4755-80ea-ce3a8c134f7c,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1e08bcc-68') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1e08bcc-68, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa543a21-2981-4058-8e79-310cfa2a5914) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: INFO os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:e9:4d,bridge_name='br-int',has_traffic_filtering=True,id=f1e08bcc-68c7-4755-80ea-ce3a8c134f7c,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf1e08bcc-68')
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:80,bridge_name='br-int',has_traffic_filtering=True,id=cea6f662-54ce-411f-98ba-d7c05acf8f59,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcea6f662-54') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:80,bridge_name='br-int',has_traffic_filtering=True,id=cea6f662-54ce-411f-98ba-d7c05acf8f59,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcea6f662-54') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcea6f662-54, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29870344-a5de-4a95-aaef-66be6c4d970a) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: INFO os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:80,bridge_name='br-int',has_traffic_filtering=True,id=cea6f662-54ce-411f-98ba-d7c05acf8f59,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcea6f662-54')
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ad:ef,bridge_name='br-int',has_traffic_filtering=True,id=50068be6-b4d5-4089-a0c6-a0b8b9ef7044,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50068be6-b4') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ad:ef,bridge_name='br-int',has_traffic_filtering=True,id=50068be6-b4d5-4089-a0c6-a0b8b9ef7044,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50068be6-b4') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50068be6-b4, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2570784e-000f-468a-84b9-b574e41df4de) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: INFO os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ad:ef,bridge_name='br-int',has_traffic_filtering=True,id=50068be6-b4d5-4089-a0c6-a0b8b9ef7044,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50068be6-b4')
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "address": "fa:16:3e:e8:4f:e0", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf893a0fc-a8", "ovs_interfaceid": "f893a0fc-a870-456c-bbf9-f00fd80130f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4f:e0,bridge_name='br-int',has_traffic_filtering=True,id=f893a0fc-a870-456c-bbf9-f00fd80130f5,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf893a0fc-a8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4f:e0,bridge_name='br-int',has_traffic_filtering=True,id=f893a0fc-a870-456c-bbf9-f00fd80130f5,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf893a0fc-a8') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf893a0fc-a8, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7243bc34-2ffe-4ac8-b330-7c90de704b77) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: INFO os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4f:e0,bridge_name='br-int',has_traffic_filtering=True,id=f893a0fc-a870-456c-bbf9-f00fd80130f5,network=Network(356697f2-ea55-463e-9197-eca5e9229530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf893a0fc-a8')
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=8ea41a22-a65d-41ab-8658-fe14d9386822,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea41a22-a6') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=8ea41a22-a65d-41ab-8658-fe14d9386822,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea41a22-a6') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea41a22-a6, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db36c874-b64a-4bd5-a940-e25ac6c6fd40) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: INFO os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:8b,bridge_name='br-int',has_traffic_filtering=True,id=8ea41a22-a65d-41ab-8658-fe14d9386822,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea41a22-a6')
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-268298786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-268298786',id=17,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGES2jogtqwd8BrTU4NtKDC8spxEZQoBxyglO6FJPzMFojLrORPWhZbGS68AFbc03NJjWXX3jwpGjBcWqh0pxTNsRiz5be239MMBh252PZfZdCfU8txkegAk74oXGSGow==',key_name='tempest-keypair-530025940',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5b887638a24af38c1641516bfb376e',ramdisk_id='',reservation_id='r-ts3q5qy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-835267361',owner_user_name='tempest-TaggedBootDevicesTest-835267361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27e0181a13a424e936577bcca742d61',uuid=b3e1c6ff-87c8-48e7-8f05-693d26138bf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converting VIF {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:38:86,bridge_name='br-int',has_traffic_filtering=True,id=c16bdc9c-2454-43b3-b4c4-2f28ab154894,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16bdc9c-24') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:38:86,bridge_name='br-int',has_traffic_filtering=True,id=c16bdc9c-2454-43b3-b4c4-2f28ab154894,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16bdc9c-24') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc16bdc9c-24, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-5f0717ec-fb17-491c-9652-75a0a2634da9 for instance with vm_state active and task_state deleting.
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-unplugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-f1e08bcc-68c7-4755-80ea-ce3a8c134f7c for instance with vm_state active and task_state deleting.
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-unplugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-f893a0fc-a870-456c-bbf9-f00fd80130f5 for instance with vm_state active and task_state deleting.
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-unplugged-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-8ea41a22-a65d-41ab-8658-fe14d9386822 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-8ea41a22-a65d-41ab-8658-fe14d9386822 for instance with vm_state active and task_state deleting.
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-unplugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-15e75c22-e9ae-492d-8985-414b38c54c97 req-5f66a5aa-1a4f-410b-8c77-a7544aee9417 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-unplugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efe775e7-93d9-4ee6-ae2c-79152c084b29) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:03 user nova-compute[74959]: INFO os_vif [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:38:86,bridge_name='br-int',has_traffic_filtering=True,id=c16bdc9c-2454-43b3-b4c4-2f28ab154894,network=Network(c552f415-ed12-4534-aedb-760bf8978f22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16bdc9c-24')
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBTWoYFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[414ddb45-c63b-4424-9357-8e6943def703]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]: iSNS:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]: STATIC:
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: FIRMWARE:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:06:03 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:06:03 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[45824f98-f6e6-424c-b807-9f4bbd43df22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a76a6-4273-4a89-96ab-74219f67f7db]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef78dbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9'): ({'sdh'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Removing single pathed devices sdh {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-c6ac40ff-462a-4bfe-81b9-8e41c427d130 req-5a3e38cc-e37e-4bf8-93f3-493e62d6e697 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c6ac40ff-462a-4bfe-81b9-8e41c427d130 req-5a3e38cc-e37e-4bf8-93f3-493e62d6e697 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c6ac40ff-462a-4bfe-81b9-8e41c427d130 req-5a3e38cc-e37e-4bf8-93f3-493e62d6e697 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c6ac40ff-462a-4bfe-81b9-8e41c427d130 req-5a3e38cc-e37e-4bf8-93f3-493e62d6e697 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-c6ac40ff-462a-4bfe-81b9-8e41c427d130 req-5a3e38cc-e37e-4bf8-93f3-493e62d6e697 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING nova.compute.manager [req-c6ac40ff-462a-4bfe-81b9-8e41c427d130 req-5a3e38cc-e37e-4bf8-93f3-493e62d6e697 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 for instance with vm_state active and task_state deleting.
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e2bfcc-e4b9-4783-8310-cc04ae9907f0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627feb4-1128-474a-b195-328a6f42a3ca]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Flushing IO for device /dev/sdh {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daf6858-71d2-42f7-a9d8-426c43d90564]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3186070b-e993-46af-8aaa-984e80ec26cb]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] SCSI volumes sdh have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8637d79-9b88-4a15-8ebc-31c3da0e622e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4c3b7e-363f-488e-90a5-cfc93c908a73]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9, portal: 172.16.0.220,3260]
Nov 28 23:06:03 user nova-compute[74959]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9, portal: 172.16.0.220,3260] successful.
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faed3ce-1cd1-4bdd-9d34-176e4aa510b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4629dea0-a09a-434e-83de-334133d62430]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== disconnect_volume: return (325ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLpFoJzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdbbbb9-0dea-4d15-b020-a4a80121c077]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]: iSNS:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]: STATIC:
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: FIRMWARE:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:06:03 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:06:03 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c860353b-3a1e-4a97-a573-90f8e0fde1d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1abd5f-f196-41a1-809e-61f2aced1020]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:03 user nova-compute[74959]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4740dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa'): ({'sdf'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Removing single pathed devices sdf {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e274840-b979-49a1-8450-57addd2d41bb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c5dbb2-4656-4dd1-9cd3-f7518443efa5]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Flushing IO for device /dev/sdf {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[962a9dc3-c356-40a5-a2af-8a2778926158]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[684af984-114e-4f3a-93a2-7c0462af7120]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-f4a2262f-2b4d-4124-b6aa-ccf28ae5f2b6 req-5db44bf3-a898-4d31-89f8-9b67efcb80d4 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4a2262f-2b4d-4124-b6aa-ccf28ae5f2b6 req-5db44bf3-a898-4d31-89f8-9b67efcb80d4 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4a2262f-2b4d-4124-b6aa-ccf28ae5f2b6 req-5db44bf3-a898-4d31-89f8-9b67efcb80d4 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4a2262f-2b4d-4124-b6aa-ccf28ae5f2b6 req-5db44bf3-a898-4d31-89f8-9b67efcb80d4 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-f4a2262f-2b4d-4124-b6aa-ccf28ae5f2b6 req-5db44bf3-a898-4d31-89f8-9b67efcb80d4 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING nova.compute.manager [req-f4a2262f-2b4d-4124-b6aa-ccf28ae5f2b6 req-5db44bf3-a898-4d31-89f8-9b67efcb80d4 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-cea6f662-54ce-411f-98ba-d7c05acf8f59 for instance with vm_state active and task_state deleting.
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b48303-6d33-4fe3-b057-28c15356e71e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1355835-7636-411f-8ef3-85fe1b869a9a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa, portal: 172.16.0.220,3260]
Nov 28 23:06:03 user nova-compute[74959]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa, portal: 172.16.0.220,3260] successful.
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c60692e-a677-4060-a1b8-b1a2c27068fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a42fd-2bbd-46bf-8586-498dfbebfab9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== disconnect_volume: return (333ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJOIHtDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:06:03 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d23d27-d22f-4e4c-852f-3f908181f787]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]: iSNS:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]: STATIC:
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:06:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:06:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:06:03 user nova-compute[74959]: FIRMWARE:
Nov 28 23:06:03 user nova-compute[74959]: No targets found.
Nov 28 23:06:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:06:03 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:06:03 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b83bf62-c5e1-49a1-b1ef-23ab6f7c6cdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53ab0a6-92cf-44f5-9e61-0b8121fdc1ca]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:04 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:06:04 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:04 user nova-compute[74959]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:06:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:04 user nova-compute[74959]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 (non-flash)
Nov 28 23:06:04 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:04 user nova-compute[74959]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:06:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc7d25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6'): ({'sde'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Removing single pathed devices sde {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG nova.network.neutron [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updating instance_info_cache with network_info: [{"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[04896a28-f6bd-41fd-bb58-3d484bd56e81]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Releasing lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40f22ca-f267-42ce-8005-024d799c7ae4]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Flushing IO for device /dev/sde {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cd4880-fbb7-41a4-908b-e6d0b574720e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49e56ab-6156-4cf4-8672-082404f14be2]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31fac6-1c67-4c61-9ffa-69c99a9e7804]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c11c5c2-8836-4a45-acde-34e659f76a8a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6, portal: 172.16.0.220,3260]
Nov 28 23:06:04 user nova-compute[74959]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6, portal: 172.16.0.220,3260] successful.
Nov 28 23:06:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a01a0d16-1ac9-4fd7-88bd-250245abdeb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[433c447f-f9e8-4e02-ba87-9f14423b3c22]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] <== disconnect_volume: return (388ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:06:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Deleting instance files /opt/stack/data/nova/instances/b3e1c6ff-87c8-48e7-8f05-693d26138bf5_del
Nov 28 23:06:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Deletion of /opt/stack/data/nova/instances/b3e1c6ff-87c8-48e7-8f05-693d26138bf5_del complete
Nov 28 23:06:04 user nova-compute[74959]: INFO nova.compute.manager [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Took 3.78 seconds to destroy the instance on the hypervisor.
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Instance destroyed successfully.
Nov 28 23:06:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Attempting rescue
Nov 28 23:06:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74959) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Instance directory exists: not creating {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 23:06:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Creating image(s)
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'trusted_certs' on Instance uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue" returned: 0 in 0.055s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'migration_context' on Instance uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.base [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<82c0be4a-fbed-41e9-861b-c567fb67b696> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Start _get_guest_xml network_info=[{"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:bf:9e:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'resources' on Instance uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.base [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<82c0be4a-fbed-41e9-861b-c567fb67b696> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'numa_topology' on Instance uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.base [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<82c0be4a-fbed-41e9-861b-c567fb67b696> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:05 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:06:05 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.base [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<82c0be4a-fbed-41e9-861b-c567fb67b696> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-214754837',display_name='tempest-ServerRescueNegativeTestJSON-server-214754837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-214754837',id=19,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-nbpc56z6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:21Z,user_data=None,user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=82c0be4a-fbed-41e9-861b-c567fb67b696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:bf:9e:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:bf:9e:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:9e:90,bridge_name='br-int',has_traffic_filtering=True,id=cc72f2fc-0fc3-4aef-9d98-e2a77342845d,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc72f2fc-0f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'pci_devices' on Instance uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-c8b0914f-dbc3-47f5-aeba-e8a34a13924b req-2c83ff03-b3a9-4216-9355-fbcfdfcbe193 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c8b0914f-dbc3-47f5-aeba-e8a34a13924b req-2c83ff03-b3a9-4216-9355-fbcfdfcbe193 service nova] Acquiring lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c8b0914f-dbc3-47f5-aeba-e8a34a13924b req-2c83ff03-b3a9-4216-9355-fbcfdfcbe193 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c8b0914f-dbc3-47f5-aeba-e8a34a13924b req-2c83ff03-b3a9-4216-9355-fbcfdfcbe193 service nova] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-c8b0914f-dbc3-47f5-aeba-e8a34a13924b req-2c83ff03-b3a9-4216-9355-fbcfdfcbe193 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] No waiting events found dispatching network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:05 user nova-compute[74959]: WARNING nova.compute.manager [req-c8b0914f-dbc3-47f5-aeba-e8a34a13924b req-2c83ff03-b3a9-4216-9355-fbcfdfcbe193 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received unexpected event network-vif-plugged-c16bdc9c-2454-43b3-b4c4-2f28ab154894 for instance with vm_state active and task_state deleting.
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.objects.base [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<82c0be4a-fbed-41e9-861b-c567fb67b696> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:06:05 user nova-compute[74959]:   <uuid>82c0be4a-fbed-41e9-861b-c567fb67b696</uuid>
Nov 28 23:06:05 user nova-compute[74959]:   <name>instance-00000013</name>
Nov 28 23:06:05 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:06:05 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:06:05 user nova-compute[74959]:   <metadata>
Nov 28 23:06:05 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:06:05 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:06:05 user nova-compute[74959]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-214754837</nova:name>
Nov 28 23:06:05 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:06:05</nova:creationTime>
Nov 28 23:06:05 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:06:05 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:06:05 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:06:05 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:06:05 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:06:05 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:06:05 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:06:05 user nova-compute[74959]:       <nova:owner>
Nov 28 23:06:05 user nova-compute[74959]:         <nova:user uuid="a59fecc5b484491ca4f6b326d8bfcb67">tempest-ServerRescueNegativeTestJSON-1452838145-project-member</nova:user>
Nov 28 23:06:05 user nova-compute[74959]:         <nova:project uuid="d69f1c42c1314a41ac6a4ae41fb64c7c">tempest-ServerRescueNegativeTestJSON-1452838145</nova:project>
Nov 28 23:06:05 user nova-compute[74959]:       </nova:owner>
Nov 28 23:06:05 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:06:05 user nova-compute[74959]:       <nova:ports>
Nov 28 23:06:05 user nova-compute[74959]:         <nova:port uuid="cc72f2fc-0fc3-4aef-9d98-e2a77342845d">
Nov 28 23:06:05 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 23:06:05 user nova-compute[74959]:         </nova:port>
Nov 28 23:06:05 user nova-compute[74959]:       </nova:ports>
Nov 28 23:06:05 user nova-compute[74959]:     </nova:instance>
Nov 28 23:06:05 user nova-compute[74959]:   </metadata>
Nov 28 23:06:05 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:06:05 user nova-compute[74959]:     <system>
Nov 28 23:06:05 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:06:05 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:06:05 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:06:05 user nova-compute[74959]:       <entry name="serial">82c0be4a-fbed-41e9-861b-c567fb67b696</entry>
Nov 28 23:06:05 user nova-compute[74959]:       <entry name="uuid">82c0be4a-fbed-41e9-861b-c567fb67b696</entry>
Nov 28 23:06:05 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:06:05 user nova-compute[74959]:     </system>
Nov 28 23:06:05 user nova-compute[74959]:   </sysinfo>
Nov 28 23:06:05 user nova-compute[74959]:   <os>
Nov 28 23:06:05 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:06:05 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:06:05 user nova-compute[74959]:   </os>
Nov 28 23:06:05 user nova-compute[74959]:   <features>
Nov 28 23:06:05 user nova-compute[74959]:     <acpi/>
Nov 28 23:06:05 user nova-compute[74959]:     <apic/>
Nov 28 23:06:05 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:06:05 user nova-compute[74959]:   </features>
Nov 28 23:06:05 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:06:05 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:06:05 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:06:05 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:06:05 user nova-compute[74959]:   </clock>
Nov 28 23:06:05 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:06:05 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:06:05 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:06:05 user nova-compute[74959]:   </cpu>
Nov 28 23:06:05 user nova-compute[74959]:   <devices>
Nov 28 23:06:05 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:06:05 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:06:05 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue"/>
Nov 28 23:06:05 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:06:05 user nova-compute[74959]:     </disk>
Nov 28 23:06:05 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:06:05 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:06:05 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk"/>
Nov 28 23:06:05 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:06:05 user nova-compute[74959]:     </disk>
Nov 28 23:06:05 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:06:05 user nova-compute[74959]:       <mac address="fa:16:3e:bf:9e:90"/>
Nov 28 23:06:05 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:06:05 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:06:05 user nova-compute[74959]:       <target dev="tapcc72f2fc-0f"/>
Nov 28 23:06:05 user nova-compute[74959]:     </interface>
Nov 28 23:06:05 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:06:05 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/console.log" append="off"/>
Nov 28 23:06:05 user nova-compute[74959]:     </serial>
Nov 28 23:06:05 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:06:05 user nova-compute[74959]:     <video>
Nov 28 23:06:05 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:06:05 user nova-compute[74959]:     </video>
Nov 28 23:06:05 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:06:05 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:06:05 user nova-compute[74959]:     </rng>
Nov 28 23:06:05 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:06:05 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:06:05 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:06:05 user nova-compute[74959]:     </memballoon>
Nov 28 23:06:05 user nova-compute[74959]:   </devices>
Nov 28 23:06:05 user nova-compute[74959]: </domain>
Nov 28 23:06:05 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:06:05 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Instance destroyed successfully.
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No VIF found with MAC fa:16:3e:bf:9e:90, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-unplugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] No waiting events found dispatching network-vif-unplugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:05 user nova-compute[74959]: WARNING nova.compute.manager [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received unexpected event network-vif-unplugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d for instance with vm_state active and task_state rescuing.
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] No waiting events found dispatching network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:05 user nova-compute[74959]: WARNING nova.compute.manager [req-5997822a-6efd-4be7-9596-64dcd7358693 req-6129807a-f8aa-4965-80ce-ffdda0e54568 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received unexpected event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d for instance with vm_state active and task_state rescuing.
Nov 28 23:06:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-deleted-f893a0fc-a870-456c-bbf9-f00fd80130f5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:08 user nova-compute[74959]: INFO nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Neutron deleted interface f893a0fc-a870-456c-bbf9-f00fd80130f5; detaching it from the instance and deleting it from the info cache
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.network.neutron [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "address": "fa:16:3e:38:38:86", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16bdc9c-24", "ovs_interfaceid": "c16bdc9c-2454-43b3-b4c4-2f28ab154894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Detach interface failed, port_id=f893a0fc-a870-456c-bbf9-f00fd80130f5, reason: Instance b3e1c6ff-87c8-48e7-8f05-693d26138bf5 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-deleted-c16bdc9c-2454-43b3-b4c4-2f28ab154894 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:08 user nova-compute[74959]: INFO nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Neutron deleted interface c16bdc9c-2454-43b3-b4c4-2f28ab154894; detaching it from the instance and deleting it from the info cache
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.network.neutron [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "address": "fa:16:3e:59:ad:ef", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50068be6-b4", "ovs_interfaceid": "50068be6-b4d5-4089-a0c6-a0b8b9ef7044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Detach interface failed, port_id=c16bdc9c-2454-43b3-b4c4-2f28ab154894, reason: Instance b3e1c6ff-87c8-48e7-8f05-693d26138bf5 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] No waiting events found dispatching network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:08 user nova-compute[74959]: WARNING nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received unexpected event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d for instance with vm_state active and task_state rescuing.
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-deleted-50068be6-b4d5-4089-a0c6-a0b8b9ef7044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:08 user nova-compute[74959]: INFO nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Neutron deleted interface 50068be6-b4d5-4089-a0c6-a0b8b9ef7044; detaching it from the instance and deleting it from the info cache
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.network.neutron [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [{"id": "5f0717ec-fb17-491c-9652-75a0a2634da9", "address": "fa:16:3e:65:59:9a", "network": {"id": "e7c3c1e8-81cd-4480-bbee-6669822795e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2033844359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f0717ec-fb", "ovs_interfaceid": "5f0717ec-fb17-491c-9652-75a0a2634da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "address": "fa:16:3e:35:e9:4d", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e08bcc-68", "ovs_interfaceid": "f1e08bcc-68c7-4755-80ea-ce3a8c134f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "address": "fa:16:3e:d9:51:80", "network": {"id": "356697f2-ea55-463e-9197-eca5e9229530", "bridge": "br-int", "label": "tempest-device-tagging-net1-290945196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6f662-54", "ovs_interfaceid": "cea6f662-54ce-411f-98ba-d7c05acf8f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ea41a22-a65d-41ab-8658-fe14d9386822", "address": "fa:16:3e:80:f6:8b", "network": {"id": "c552f415-ed12-4534-aedb-760bf8978f22", "bridge": "br-int", "label": "tempest-device-tagging-net2-1279649696", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2c5b887638a24af38c1641516bfb376e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea41a22-a6", "ovs_interfaceid": "8ea41a22-a65d-41ab-8658-fe14d9386822", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Detach interface failed, port_id=50068be6-b4d5-4089-a0c6-a0b8b9ef7044, reason: Instance b3e1c6ff-87c8-48e7-8f05-693d26138bf5 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] No waiting events found dispatching network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:08 user nova-compute[74959]: WARNING nova.compute.manager [req-0662e6b6-c5a5-48a8-9594-1c131dbb0c9d req-7ecce5cc-2cb3-4db1-b7f1-a49c79b1c389 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received unexpected event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d for instance with vm_state active and task_state rescuing.
Nov 28 23:06:08 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:08 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Took 4.51 seconds to deallocate network for instance.
Nov 28 23:06:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-6c81c814-2f2b-4653-ac04-fe2b3aaffde2 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:06:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-ba4b777a-f471-40f8-95b3-f3751ba2b275 req-6b51bf9b-64cc-460f-89a8-338860026280 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-deleted-8ea41a22-a65d-41ab-8658-fe14d9386822 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-ba4b777a-f471-40f8-95b3-f3751ba2b275 req-6b51bf9b-64cc-460f-89a8-338860026280 service nova] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Received event network-vif-deleted-5f0717ec-fb17-491c-9652-75a0a2634da9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 req-06c5faae-6e92-49e9-ace5-b16b936fafd7 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event volume-reimaged-858e5775-3686-4c19-b158-a2019e464c3f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 req-06c5faae-6e92-49e9-ace5-b16b936fafd7 service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 req-06c5faae-6e92-49e9-ace5-b16b936fafd7 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 req-06c5faae-6e92-49e9-ace5-b16b936fafd7 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 req-06c5faae-6e92-49e9-ace5-b16b936fafd7 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Processing event volume-reimaged-858e5775-3686-4c19-b158-a2019e464c3f {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:06:11 user nova-compute[74959]: INFO nova.virt.block_device [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Booting with volume 858e5775-3686-4c19-b158-a2019e464c3f at /dev/vda
Nov 28 23:06:11 user nova-compute[74959]: DEBUG os_brick.utils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c695c708-49ac-4443-97db-3e5b70ca3858]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c267269-6cbb-48b2-b64e-6550ae27a423]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aaeef3-f0ef-4f89-ac92-af2d009ecdda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf22164-e93c-4fd9-a658-96f48687f5ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:06:11 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeed9b0c-3e0c-4a46-9328-6d546bb72704]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG os_brick.utils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updating existing volume attachment record: a3e4a2b2-10aa-4e86-8b22-75931287ddc0 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:06:11 user nova-compute[74959]: INFO nova.compute.manager [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] [instance: b3e1c6ff-87c8-48e7-8f05-693d26138bf5] Took 2.95 seconds to detach 3 volumes for instance.
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:12 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:06:12 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:06:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:12 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Deleted allocations for instance b3e1c6ff-87c8-48e7-8f05-693d26138bf5
Nov 28 23:06:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb2bc480-3ad1-4fe9-8a1e-2afe93bb92b4 tempest-TaggedBootDevicesTest-835267361 tempest-TaggedBootDevicesTest-835267361-project-member] Lock "b3e1c6ff-87c8-48e7-8f05-693d26138bf5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.065s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:06:13 user nova-compute[74959]: INFO nova.compute.claims [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Claim successful on node user
Nov 28 23:06:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:06:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.policy [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecd0185bcfae4e058dade500ad82dbd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef225be98f448b69f250a21c002c237', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:06:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Creating image(s)
Nov 28 23:06:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.232s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:14 user nova-compute[74959]: INFO nova.compute.manager [None req-27866a7f-55ae-403a-9ac2-68bfc2091845 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Unrescuing
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-27866a7f-55ae-403a-9ac2-68bfc2091845 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-27866a7f-55ae-403a-9ac2-68bfc2091845 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquired lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-27866a7f-55ae-403a-9ac2-68bfc2091845 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk 1073741824" returned: 0 in 0.058s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.238s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Successfully created port: fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Cannot resize image /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Ensure instance console log exists: /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-27866a7f-55ae-403a-9ac2-68bfc2091845 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating instance_info_cache with network_info: [{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-27866a7f-55ae-403a-9ac2-68bfc2091845 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Releasing lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG nova.objects.instance [None req-27866a7f-55ae-403a-9ac2-68bfc2091845 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'flavor' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-eb654c08-e722-4ef7-8dd3-f7f98d96e19b req-b6713a97-5d7f-4b26-b170-018a069a9094 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eb654c08-e722-4ef7-8dd3-f7f98d96e19b req-b6713a97-5d7f-4b26-b170-018a069a9094 service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eb654c08-e722-4ef7-8dd3-f7f98d96e19b req-b6713a97-5d7f-4b26-b170-018a069a9094 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eb654c08-e722-4ef7-8dd3-f7f98d96e19b req-b6713a97-5d7f-4b26-b170-018a069a9094 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-eb654c08-e722-4ef7-8dd3-f7f98d96e19b req-b6713a97-5d7f-4b26-b170-018a069a9094 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:15 user nova-compute[74959]: WARNING nova.compute.manager [req-eb654c08-e722-4ef7-8dd3-f7f98d96e19b req-b6713a97-5d7f-4b26-b170-018a069a9094 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Successfully updated port: fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquired lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-3e52af52-1e68-4b84-8788-a48ea46233a4 req-fb70a3e6-ab2b-445d-8fee-8246d74828f0 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-changed-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-3e52af52-1e68-4b84-8788-a48ea46233a4 req-fb70a3e6-ab2b-445d-8fee-8246d74828f0 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Refreshing instance network info cache due to event network-changed-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3e52af52-1e68-4b84-8788-a48ea46233a4 req-fb70a3e6-ab2b-445d-8fee-8246d74828f0 service nova] Acquiring lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Releasing lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance network_info: |[{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3e52af52-1e68-4b84-8788-a48ea46233a4 req-fb70a3e6-ab2b-445d-8fee-8246d74828f0 service nova] Acquired lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.neutron [req-3e52af52-1e68-4b84-8788-a48ea46233a4 req-fb70a3e6-ab2b-445d-8fee-8246d74828f0 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Refreshing network info cache for port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Start _get_guest_xml network_info=[{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:06:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance destroyed successfully.
Nov 28 23:06:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:06:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1977703593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1977703593',id=23,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkxFFQQKBAfO/SApxPbwX9zAeEyNRaEAPAtbyW3Oh1BR8HoVfkbWwsOsLh2Q+1UuVyy640UwC+mHWtb8lnf6GLZY7z1dyYQrviUMet94Y7CLHS0p/0tiqszkHln2EXlA==',key_name='tempest-keypair-488060459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-gphxhirs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=f180b6b0-ff56-4d28-9a5d-06244e04c1f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'pci_devices' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:06:15 user nova-compute[74959]:   <uuid>f180b6b0-ff56-4d28-9a5d-06244e04c1f5</uuid>
Nov 28 23:06:15 user nova-compute[74959]:   <name>instance-00000017</name>
Nov 28 23:06:15 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:06:15 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:06:15 user nova-compute[74959]:   <metadata>
Nov 28 23:06:15 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:06:15 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:06:15 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1977703593</nova:name>
Nov 28 23:06:15 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:06:15</nova:creationTime>
Nov 28 23:06:15 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:06:15 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:06:15 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:06:15 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:06:15 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:06:15 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:06:15 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:06:15 user nova-compute[74959]:       <nova:owner>
Nov 28 23:06:15 user nova-compute[74959]:         <nova:user uuid="ecd0185bcfae4e058dade500ad82dbd2">tempest-AttachVolumeShelveTestJSON-533572635-project-member</nova:user>
Nov 28 23:06:15 user nova-compute[74959]:         <nova:project uuid="bef225be98f448b69f250a21c002c237">tempest-AttachVolumeShelveTestJSON-533572635</nova:project>
Nov 28 23:06:15 user nova-compute[74959]:       </nova:owner>
Nov 28 23:06:15 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:06:15 user nova-compute[74959]:       <nova:ports>
Nov 28 23:06:15 user nova-compute[74959]:         <nova:port uuid="fe6d4f6a-611a-4d09-abcc-053f06cb6e4f">
Nov 28 23:06:15 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:06:15 user nova-compute[74959]:         </nova:port>
Nov 28 23:06:15 user nova-compute[74959]:       </nova:ports>
Nov 28 23:06:15 user nova-compute[74959]:     </nova:instance>
Nov 28 23:06:15 user nova-compute[74959]:   </metadata>
Nov 28 23:06:15 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:06:15 user nova-compute[74959]:     <system>
Nov 28 23:06:15 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:06:15 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:06:15 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:06:15 user nova-compute[74959]:       <entry name="serial">f180b6b0-ff56-4d28-9a5d-06244e04c1f5</entry>
Nov 28 23:06:15 user nova-compute[74959]:       <entry name="uuid">f180b6b0-ff56-4d28-9a5d-06244e04c1f5</entry>
Nov 28 23:06:15 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:06:15 user nova-compute[74959]:     </system>
Nov 28 23:06:15 user nova-compute[74959]:   </sysinfo>
Nov 28 23:06:15 user nova-compute[74959]:   <os>
Nov 28 23:06:15 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:06:15 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:06:15 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:06:15 user nova-compute[74959]:   </os>
Nov 28 23:06:15 user nova-compute[74959]:   <features>
Nov 28 23:06:15 user nova-compute[74959]:     <acpi/>
Nov 28 23:06:15 user nova-compute[74959]:     <apic/>
Nov 28 23:06:15 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:06:15 user nova-compute[74959]:   </features>
Nov 28 23:06:15 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:06:15 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:06:15 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:06:15 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:06:15 user nova-compute[74959]:   </clock>
Nov 28 23:06:15 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:06:15 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:06:15 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:06:15 user nova-compute[74959]:   </cpu>
Nov 28 23:06:15 user nova-compute[74959]:   <devices>
Nov 28 23:06:15 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:06:15 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:06:15 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk"/>
Nov 28 23:06:15 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:06:15 user nova-compute[74959]:     </disk>
Nov 28 23:06:15 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:06:15 user nova-compute[74959]:       <mac address="fa:16:3e:56:0c:e2"/>
Nov 28 23:06:15 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:06:15 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:06:15 user nova-compute[74959]:       <target dev="tapfe6d4f6a-61"/>
Nov 28 23:06:15 user nova-compute[74959]:     </interface>
Nov 28 23:06:15 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:06:15 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/console.log" append="off"/>
Nov 28 23:06:15 user nova-compute[74959]:     </serial>
Nov 28 23:06:15 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:06:15 user nova-compute[74959]:     <video>
Nov 28 23:06:15 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:06:15 user nova-compute[74959]:     </video>
Nov 28 23:06:15 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:06:15 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:06:15 user nova-compute[74959]:     </rng>
Nov 28 23:06:15 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:06:15 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:06:15 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:06:15 user nova-compute[74959]:     </memballoon>
Nov 28 23:06:15 user nova-compute[74959]:   </devices>
Nov 28 23:06:15 user nova-compute[74959]: </domain>
Nov 28 23:06:15 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1977703593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1977703593',id=23,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkxFFQQKBAfO/SApxPbwX9zAeEyNRaEAPAtbyW3Oh1BR8HoVfkbWwsOsLh2Q+1UuVyy640UwC+mHWtb8lnf6GLZY7z1dyYQrviUMet94Y7CLHS0p/0tiqszkHln2EXlA==',key_name='tempest-keypair-488060459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-gphxhirs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=f180b6b0-ff56-4d28-9a5d-06244e04c1f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG os_vif [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '585b0cc5-c69c-5b8e-8422-759ea1164585', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe6d4f6a-61, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe6d4f6a-61, col_values=(('qos', UUID('bb2d0b0e-632a-4f98-873a-32380511e5e8')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe6d4f6a-61, col_values=(('external_ids', {'iface-id': 'fe6d4f6a-611a-4d09-abcc-053f06cb6e4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:0c:e2', 'vm-uuid': 'f180b6b0-ff56-4d28-9a5d-06244e04c1f5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:15 user nova-compute[74959]: INFO os_vif [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61')
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:06:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No VIF found with MAC fa:16:3e:56:0c:e2, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:06:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-3e52af52-1e68-4b84-8788-a48ea46233a4 req-fb70a3e6-ab2b-445d-8fee-8246d74828f0 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updated VIF entry in instance network info cache for port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:06:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-3e52af52-1e68-4b84-8788-a48ea46233a4 req-fb70a3e6-ab2b-445d-8fee-8246d74828f0 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3e52af52-1e68-4b84-8788-a48ea46233a4 req-fb70a3e6-ab2b-445d-8fee-8246d74828f0 service nova] Releasing lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-b1ccd115-ae8a-423d-87b8-676501f5e1be req-2ad876e8-d496-403e-82f4-c9d94d68e07f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b1ccd115-ae8a-423d-87b8-676501f5e1be req-2ad876e8-d496-403e-82f4-c9d94d68e07f service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b1ccd115-ae8a-423d-87b8-676501f5e1be req-2ad876e8-d496-403e-82f4-c9d94d68e07f service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b1ccd115-ae8a-423d-87b8-676501f5e1be req-2ad876e8-d496-403e-82f4-c9d94d68e07f service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-b1ccd115-ae8a-423d-87b8-676501f5e1be req-2ad876e8-d496-403e-82f4-c9d94d68e07f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:17 user nova-compute[74959]: WARNING nova.compute.manager [req-b1ccd115-ae8a-423d-87b8-676501f5e1be req-2ad876e8-d496-403e-82f4-c9d94d68e07f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:06:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-b91bf83b-ab11-4a73-9858-0c019449e52e req-d6fe08b5-8e51-4054-b5e9-a4e02d425584 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b91bf83b-ab11-4a73-9858-0c019449e52e req-d6fe08b5-8e51-4054-b5e9-a4e02d425584 service nova] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b91bf83b-ab11-4a73-9858-0c019449e52e req-d6fe08b5-8e51-4054-b5e9-a4e02d425584 service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b91bf83b-ab11-4a73-9858-0c019449e52e req-d6fe08b5-8e51-4054-b5e9-a4e02d425584 service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-b91bf83b-ab11-4a73-9858-0c019449e52e req-d6fe08b5-8e51-4054-b5e9-a4e02d425584 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] No waiting events found dispatching network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:18 user nova-compute[74959]: WARNING nova.compute.manager [req-b91bf83b-ab11-4a73-9858-0c019449e52e req-d6fe08b5-8e51-4054-b5e9-a4e02d425584 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received unexpected event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f for instance with vm_state building and task_state spawning.
Nov 28 23:06:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:19 user nova-compute[74959]: WARNING nova.compute.manager [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:06:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:19 user nova-compute[74959]: WARNING nova.compute.manager [req-c05b460b-a7f3-4112-8955-c40b45371259 req-886f8dea-06f1-42b0-af6a-d1365e34e11f service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:06:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:06:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Creating image(s)
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Ensure instance console log exists: /opt/stack/data/nova/instances/e1174ec3-4ec5-4538-b304-60c76ec41bc8/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Start _get_guest_xml network_info=[{"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1174ec3-4ec5-4538-b304-60c76ec41bc8', 'attached_at': '', 'detached_at': '', 'volume_id': '858e5775-3686-4c19-b158-a2019e464c3f', 'serial': '858e5775-3686-4c19-b158-a2019e464c3f'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'a3e4a2b2-10aa-4e86-8b22-75931287ddc0', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:06:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 23:06:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1174ec3-4ec5-4538-b304-60c76ec41bc8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:06:20 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:06:20 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:06:20 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de10c3d-0c5f-44e8-b416-e8a011bc6e3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:06:20 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a69e375-2265-4381-a239-3f88b8ca99ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f] added
Nov 28 23:06:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-44c89376-c372-4f1c-a62b-2350dcca01e9 req-3c0d0a88-3c47-4abc-bb4f-86bfbea46966 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-44c89376-c372-4f1c-a62b-2350dcca01e9 req-3c0d0a88-3c47-4abc-bb4f-86bfbea46966 service nova] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-44c89376-c372-4f1c-a62b-2350dcca01e9 req-3c0d0a88-3c47-4abc-bb4f-86bfbea46966 service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-44c89376-c372-4f1c-a62b-2350dcca01e9 req-3c0d0a88-3c47-4abc-bb4f-86bfbea46966 service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.compute.manager [req-44c89376-c372-4f1c-a62b-2350dcca01e9 req-3c0d0a88-3c47-4abc-bb4f-86bfbea46966 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] No waiting events found dispatching network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:20 user nova-compute[74959]: WARNING nova.compute.manager [req-44c89376-c372-4f1c-a62b-2350dcca01e9 req-3c0d0a88-3c47-4abc-bb4f-86bfbea46966 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received unexpected event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f for instance with vm_state building and task_state spawning.
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[85825c88-d152-4bc4-b046-6a7d332905c5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[825b8c0e-6bc8-4545-8daf-ca939afcbf7b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eAzQlyCP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eAzQlyCP" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f4374b-1c81-4f29-b188-79c8fac6fde9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eAzQlyCP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a7559c-0969-4f67-9a33-7355fd73b021]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd9d89-f591-4e74-a851-391c93491462]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:20 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:20 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6cde39-8ee2-4137-8292-4d3c2d87b8c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260]
Nov 28 23:06:20 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260] successful.
Nov 28 23:06:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6189f8db-6420-40f7-83a7-2710c0cbf874]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab35e9e9-a9a3-46e5-9f33-8441d3d4e3af]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:20 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:20 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:06:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:06:20 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:06:20 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:06:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fdf5b2-d12a-420b-bb4c-540089887df1]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:06:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance spawned successfully.
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-27866a7f-55ae-403a-9ac2-68bfc2091845 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:06:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:21 user nova-compute[74959]: INFO nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:06:21 user nova-compute[74959]: INFO nova.compute.manager [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Took 8.10 seconds to build instance.
Nov 28 23:06:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d2031b8b-5dde-4903-94d5-56a9ab5b8575 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.194s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26237386533626536', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237386533626536', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-89980862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1082676943',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqlpUARw/Tw9Nep95ScVmpCyPLJQOmSxAF1Y8ckwlsqtwT3jkaO4sDEsT0fDyaLML9r92WMny0erSsnO6MqU3oYNLrvO04b6VpEa5izHmhsvTDkh8uyrgG5eXNd00UpqQ==',key_name='tempest-keypair-1243684358',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40c538561f8446748937abce99e7eddf',ramdisk_id='',reservation_id='r-psdni240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-95008496',owner_user_name='tempest-ServerActionsV293TestJSON-95008496-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a20b8445a0a744588f59526545b4bc95',uuid=e1174ec3-4ec5-4538-b304-60c76ec41bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converting VIF {"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:06:21 user nova-compute[74959]:   <uuid>e1174ec3-4ec5-4538-b304-60c76ec41bc8</uuid>
Nov 28 23:06:21 user nova-compute[74959]:   <name>instance-00000010</name>
Nov 28 23:06:21 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:06:21 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:06:21 user nova-compute[74959]:   <metadata>
Nov 28 23:06:21 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:06:21 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:06:21 user nova-compute[74959]:       <nova:name>tempest-ServerActionsV293TestJSON-server-89980862</nova:name>
Nov 28 23:06:21 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:06:20</nova:creationTime>
Nov 28 23:06:21 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:06:21 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:06:21 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:06:21 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:06:21 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:06:21 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:06:21 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:06:21 user nova-compute[74959]:       <nova:owner>
Nov 28 23:06:21 user nova-compute[74959]:         <nova:user uuid="a20b8445a0a744588f59526545b4bc95">tempest-ServerActionsV293TestJSON-95008496-project-member</nova:user>
Nov 28 23:06:21 user nova-compute[74959]:         <nova:project uuid="40c538561f8446748937abce99e7eddf">tempest-ServerActionsV293TestJSON-95008496</nova:project>
Nov 28 23:06:21 user nova-compute[74959]:       </nova:owner>
Nov 28 23:06:21 user nova-compute[74959]:       <nova:ports>
Nov 28 23:06:21 user nova-compute[74959]:         <nova:port uuid="5ced9d93-efc5-4031-8356-265e81b5884f">
Nov 28 23:06:21 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 23:06:21 user nova-compute[74959]:         </nova:port>
Nov 28 23:06:21 user nova-compute[74959]:       </nova:ports>
Nov 28 23:06:21 user nova-compute[74959]:     </nova:instance>
Nov 28 23:06:21 user nova-compute[74959]:   </metadata>
Nov 28 23:06:21 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:06:21 user nova-compute[74959]:     <system>
Nov 28 23:06:21 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:06:21 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:06:21 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:06:21 user nova-compute[74959]:       <entry name="serial">e1174ec3-4ec5-4538-b304-60c76ec41bc8</entry>
Nov 28 23:06:21 user nova-compute[74959]:       <entry name="uuid">e1174ec3-4ec5-4538-b304-60c76ec41bc8</entry>
Nov 28 23:06:21 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:06:21 user nova-compute[74959]:     </system>
Nov 28 23:06:21 user nova-compute[74959]:   </sysinfo>
Nov 28 23:06:21 user nova-compute[74959]:   <os>
Nov 28 23:06:21 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:06:21 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:06:21 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:06:21 user nova-compute[74959]:   </os>
Nov 28 23:06:21 user nova-compute[74959]:   <features>
Nov 28 23:06:21 user nova-compute[74959]:     <acpi/>
Nov 28 23:06:21 user nova-compute[74959]:     <apic/>
Nov 28 23:06:21 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:06:21 user nova-compute[74959]:   </features>
Nov 28 23:06:21 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:06:21 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:06:21 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:06:21 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:06:21 user nova-compute[74959]:   </clock>
Nov 28 23:06:21 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:06:21 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:06:21 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:06:21 user nova-compute[74959]:   </cpu>
Nov 28 23:06:21 user nova-compute[74959]:   <devices>
Nov 28 23:06:21 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:06:21 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:06:21 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:06:21 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:06:21 user nova-compute[74959]:       <serial>858e5775-3686-4c19-b158-a2019e464c3f</serial>
Nov 28 23:06:21 user nova-compute[74959]:     </disk>
Nov 28 23:06:21 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:06:21 user nova-compute[74959]:       <mac address="fa:16:3e:e5:8a:f2"/>
Nov 28 23:06:21 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:06:21 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:06:21 user nova-compute[74959]:       <target dev="tap5ced9d93-ef"/>
Nov 28 23:06:21 user nova-compute[74959]:     </interface>
Nov 28 23:06:21 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:06:21 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/e1174ec3-4ec5-4538-b304-60c76ec41bc8/console.log" append="off"/>
Nov 28 23:06:21 user nova-compute[74959]:     </serial>
Nov 28 23:06:21 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:06:21 user nova-compute[74959]:     <video>
Nov 28 23:06:21 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:06:21 user nova-compute[74959]:     </video>
Nov 28 23:06:21 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:06:21 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:06:21 user nova-compute[74959]:     </rng>
Nov 28 23:06:21 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:06:21 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:06:21 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:06:21 user nova-compute[74959]:     </memballoon>
Nov 28 23:06:21 user nova-compute[74959]:   </devices>
Nov 28 23:06:21 user nova-compute[74959]: </domain>
Nov 28 23:06:21 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-89980862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1082676943',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqlpUARw/Tw9Nep95ScVmpCyPLJQOmSxAF1Y8ckwlsqtwT3jkaO4sDEsT0fDyaLML9r92WMny0erSsnO6MqU3oYNLrvO04b6VpEa5izHmhsvTDkh8uyrgG5eXNd00UpqQ==',key_name='tempest-keypair-1243684358',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40c538561f8446748937abce99e7eddf',ramdisk_id='',reservation_id='r-psdni240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-95008496',owner_user_name='tempest-ServerActionsV293TestJSON-95008496-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a20b8445a0a744588f59526545b4bc95',uuid=e1174ec3-4ec5-4538-b304-60c76ec41bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converting VIF {"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG os_vif [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0410e7e3-f93a-5a6d-b8bd-f35e0b570a55', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ced9d93-ef, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ced9d93-ef, col_values=(('qos', UUID('453eea89-e849-48d2-8b0f-02d8543a8206')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ced9d93-ef, col_values=(('external_ids', {'iface-id': '5ced9d93-efc5-4031-8356-265e81b5884f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:8a:f2', 'vm-uuid': 'e1174ec3-4ec5-4538-b304-60c76ec41bc8'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:21 user nova-compute[74959]: INFO os_vif [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef')
Nov 28 23:06:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:06:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] No VIF found with MAC fa:16:3e:e5:8a:f2, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-59fb47dd-e8eb-4ee2-b1f2-7a3b9e3b11ba req-d57ab951-5b65-4e23-ab58-a272862b9c77 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-59fb47dd-e8eb-4ee2-b1f2-7a3b9e3b11ba req-d57ab951-5b65-4e23-ab58-a272862b9c77 service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-59fb47dd-e8eb-4ee2-b1f2-7a3b9e3b11ba req-d57ab951-5b65-4e23-ab58-a272862b9c77 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-59fb47dd-e8eb-4ee2-b1f2-7a3b9e3b11ba req-d57ab951-5b65-4e23-ab58-a272862b9c77 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-59fb47dd-e8eb-4ee2-b1f2-7a3b9e3b11ba req-d57ab951-5b65-4e23-ab58-a272862b9c77 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] No waiting events found dispatching network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:23 user nova-compute[74959]: WARNING nova.compute.manager [req-59fb47dd-e8eb-4ee2-b1f2-7a3b9e3b11ba req-d57ab951-5b65-4e23-ab58-a272862b9c77 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received unexpected event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f for instance with vm_state active and task_state rebuild_spawning.
Nov 28 23:06:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:06:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance spawned successfully.
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-29479157-8936-44fb-bdcc-f71be0e5bc3f req-37986fad-b524-435f-8fb7-34877068e210 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-29479157-8936-44fb-bdcc-f71be0e5bc3f req-37986fad-b524-435f-8fb7-34877068e210 service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-29479157-8936-44fb-bdcc-f71be0e5bc3f req-37986fad-b524-435f-8fb7-34877068e210 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-29479157-8936-44fb-bdcc-f71be0e5bc3f req-37986fad-b524-435f-8fb7-34877068e210 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-29479157-8936-44fb-bdcc-f71be0e5bc3f req-37986fad-b524-435f-8fb7-34877068e210 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] No waiting events found dispatching network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:06:25 user nova-compute[74959]: WARNING nova.compute.manager [req-29479157-8936-44fb-bdcc-f71be0e5bc3f req-37986fad-b524-435f-8fb7-34877068e210 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received unexpected event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f for instance with vm_state active and task_state rebuild_spawning.
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74959) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3e05ab0c-c1f5-4694-9e2a-7b22e8c88851 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:06:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:06:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:06:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:06:35 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:06:35 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:36 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updating instance_info_cache with network_info: [{"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:06:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:06:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:06:43 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:06:43 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:06:43 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7324MB free_disk=25.27533721923828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7011df2d-f2c5-48ba-8d4c-d0539c235917 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e1174ec3-4ec5-4538-b304-60c76ec41bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 3fbcfd9e-bf33-4452-8a4f-8500ec54df51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance f180b6b0-ff56-4d28-9a5d-06244e04c1f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:06:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:06:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:06:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:06:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquired lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'info_cache' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.base [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Releasing lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:06:59 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance destroyed successfully.
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'resources' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.base [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG os_vif [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapded8a2c4-07, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1eae101c-07d1-4d7d-8a44-ab6db192f5d5) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:06:59 user nova-compute[74959]: INFO os_vif [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07')
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Start _get_guest_xml network_info=[{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'numa_topology' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.base [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:06:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.base [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'pci_devices' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.objects.base [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:06:59 user nova-compute[74959]:   <uuid>9492b249-758e-4b8f-acfb-f334ef80a9dd</uuid>
Nov 28 23:06:59 user nova-compute[74959]:   <name>instance-00000006</name>
Nov 28 23:06:59 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:06:59 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:06:59 user nova-compute[74959]:   <metadata>
Nov 28 23:06:59 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:06:59 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:06:59 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeTestJSON-server-1150032391</nova:name>
Nov 28 23:06:59 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:06:59</nova:creationTime>
Nov 28 23:06:59 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:06:59 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:06:59 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:06:59 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:06:59 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:06:59 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:06:59 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:06:59 user nova-compute[74959]:       <nova:owner>
Nov 28 23:06:59 user nova-compute[74959]:         <nova:user uuid="ba2c8fce9ab041ba928f65f59468683e">tempest-AttachVolumeTestJSON-803300239-project-member</nova:user>
Nov 28 23:06:59 user nova-compute[74959]:         <nova:project uuid="c95b70a9bba84ebc95d6d7aea0d8c649">tempest-AttachVolumeTestJSON-803300239</nova:project>
Nov 28 23:06:59 user nova-compute[74959]:       </nova:owner>
Nov 28 23:06:59 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:06:59 user nova-compute[74959]:       <nova:ports>
Nov 28 23:06:59 user nova-compute[74959]:         <nova:port uuid="ded8a2c4-07d6-440e-9110-4c2a7b2738f2">
Nov 28 23:06:59 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:06:59 user nova-compute[74959]:         </nova:port>
Nov 28 23:06:59 user nova-compute[74959]:       </nova:ports>
Nov 28 23:06:59 user nova-compute[74959]:     </nova:instance>
Nov 28 23:06:59 user nova-compute[74959]:   </metadata>
Nov 28 23:06:59 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:06:59 user nova-compute[74959]:     <system>
Nov 28 23:06:59 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:06:59 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:06:59 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:06:59 user nova-compute[74959]:       <entry name="serial">9492b249-758e-4b8f-acfb-f334ef80a9dd</entry>
Nov 28 23:06:59 user nova-compute[74959]:       <entry name="uuid">9492b249-758e-4b8f-acfb-f334ef80a9dd</entry>
Nov 28 23:06:59 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:06:59 user nova-compute[74959]:     </system>
Nov 28 23:06:59 user nova-compute[74959]:   </sysinfo>
Nov 28 23:06:59 user nova-compute[74959]:   <os>
Nov 28 23:06:59 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:06:59 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:06:59 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:06:59 user nova-compute[74959]:   </os>
Nov 28 23:06:59 user nova-compute[74959]:   <features>
Nov 28 23:06:59 user nova-compute[74959]:     <acpi/>
Nov 28 23:06:59 user nova-compute[74959]:     <apic/>
Nov 28 23:06:59 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:06:59 user nova-compute[74959]:   </features>
Nov 28 23:06:59 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:06:59 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:06:59 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:06:59 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:06:59 user nova-compute[74959]:   </clock>
Nov 28 23:06:59 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:06:59 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:06:59 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:06:59 user nova-compute[74959]:   </cpu>
Nov 28 23:06:59 user nova-compute[74959]:   <devices>
Nov 28 23:06:59 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:06:59 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:06:59 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk"/>
Nov 28 23:06:59 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:06:59 user nova-compute[74959]:     </disk>
Nov 28 23:06:59 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:06:59 user nova-compute[74959]:       <mac address="fa:16:3e:69:f4:ad"/>
Nov 28 23:06:59 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:06:59 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:06:59 user nova-compute[74959]:       <target dev="tapded8a2c4-07"/>
Nov 28 23:06:59 user nova-compute[74959]:     </interface>
Nov 28 23:06:59 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:06:59 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/console.log" append="off"/>
Nov 28 23:06:59 user nova-compute[74959]:     </serial>
Nov 28 23:06:59 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:06:59 user nova-compute[74959]:     <video>
Nov 28 23:06:59 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:06:59 user nova-compute[74959]:     </video>
Nov 28 23:06:59 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:06:59 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:06:59 user nova-compute[74959]:     </rng>
Nov 28 23:06:59 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:06:59 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:06:59 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:06:59 user nova-compute[74959]:     </memballoon>
Nov 28 23:06:59 user nova-compute[74959]:   </devices>
Nov 28 23:06:59 user nova-compute[74959]: </domain>
Nov 28 23:06:59 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:06:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.objects.base [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Cannot resize image /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'migration_context' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.objects.base [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Object Instance<9492b249-758e-4b8f-acfb-f334ef80a9dd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG os_vif [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2570ecb9-1128-584b-a1cb-dd1ea8f8f7bb', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapded8a2c4-07, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapded8a2c4-07, col_values=(('qos', UUID('7da20d87-64bc-4583-9368-b384247523d5')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapded8a2c4-07, col_values=(('external_ids', {'iface-id': 'ded8a2c4-07d6-440e-9110-4c2a7b2738f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:f4:ad', 'vm-uuid': '9492b249-758e-4b8f-acfb-f334ef80a9dd'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:07:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:00 user nova-compute[74959]: INFO os_vif [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07')
Nov 28 23:07:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-c56ee81b-83a8-4f90-8a55-2fe188b9a728 req-17091337-74d0-49a0-83ca-6df84ae21a18 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c56ee81b-83a8-4f90-8a55-2fe188b9a728 req-17091337-74d0-49a0-83ca-6df84ae21a18 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c56ee81b-83a8-4f90-8a55-2fe188b9a728 req-17091337-74d0-49a0-83ca-6df84ae21a18 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c56ee81b-83a8-4f90-8a55-2fe188b9a728 req-17091337-74d0-49a0-83ca-6df84ae21a18 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-c56ee81b-83a8-4f90-8a55-2fe188b9a728 req-17091337-74d0-49a0-83ca-6df84ae21a18 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:02 user nova-compute[74959]: WARNING nova.compute.manager [req-c56ee81b-83a8-4f90-8a55-2fe188b9a728 req-17091337-74d0-49a0-83ca-6df84ae21a18 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state stopped and task_state powering-on.
Nov 28 23:07:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:07:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance rebooted successfully.
Nov 28 23:07:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ea95f116-955d-4f71-9081-dfe42aa6a1dc tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:07:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-a888e808-4718-41c8-bed1-c136d5fff026 req-ca4415a6-631b-4c08-9b3a-7996166dc363 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a888e808-4718-41c8-bed1-c136d5fff026 req-ca4415a6-631b-4c08-9b3a-7996166dc363 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a888e808-4718-41c8-bed1-c136d5fff026 req-ca4415a6-631b-4c08-9b3a-7996166dc363 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a888e808-4718-41c8-bed1-c136d5fff026 req-ca4415a6-631b-4c08-9b3a-7996166dc363 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-a888e808-4718-41c8-bed1-c136d5fff026 req-ca4415a6-631b-4c08-9b3a-7996166dc363 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:04 user nova-compute[74959]: WARNING nova.compute.manager [req-a888e808-4718-41c8-bed1-c136d5fff026 req-ca4415a6-631b-4c08-9b3a-7996166dc363 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state active and task_state None.
Nov 28 23:07:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:07:05 user nova-compute[74959]: INFO nova.compute.claims [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Claim successful on node user
Nov 28 23:07:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:07:05 user nova-compute[74959]: DEBUG nova.network.neutron [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:07:05 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:07:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:07:06 user nova-compute[74959]: INFO nova.virt.block_device [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Booting with volume f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d at /dev/vda
Nov 28 23:07:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG nova.policy [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '305832e59f9846b2923717725a362cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e326f1cb3b64f78b1cd0ef5adc09323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG os_brick.utils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[006710c4-14f2-48bd-8243-e7c08706a65d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aacad7-c23a-4cc6-95d0-3b8d55fbcd13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[666b0b85-34d9-4ea3-921e-79470c98bae4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15012c9-a1b8-44b0-b19b-aa0bb0e72c33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:07:06 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:07:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d9c0e-2475-45ef-ac98-08d8f1e4815d]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG os_brick.utils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating existing volume attachment record: 6da47c75-7f8f-4b2d-b079-9cb0bfb698b6 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:07:06 user nova-compute[74959]: DEBUG nova.network.neutron [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Successfully created port: 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Successfully updated port: 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquired lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-4f6ca583-f914-48be-9efa-eb62493abdd9 req-45cc8ee0-ab14-4598-be4c-4d3554f5d1f3 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-4f6ca583-f914-48be-9efa-eb62493abdd9 req-45cc8ee0-ab14-4598-be4c-4d3554f5d1f3 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing instance network info cache due to event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f6ca583-f914-48be-9efa-eb62493abdd9 req-45cc8ee0-ab14-4598-be4c-4d3554f5d1f3 service nova] Acquiring lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Releasing lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance network_info: |[{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f6ca583-f914-48be-9efa-eb62493abdd9 req-45cc8ee0-ab14-4598-be4c-4d3554f5d1f3 service nova] Acquired lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:07:07 user nova-compute[74959]: DEBUG nova.network.neutron [req-4f6ca583-f914-48be-9efa-eb62493abdd9 req-45cc8ee0-ab14-4598-be4c-4d3554f5d1f3 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:07:08 user nova-compute[74959]: DEBUG nova.network.neutron [req-4f6ca583-f914-48be-9efa-eb62493abdd9 req-45cc8ee0-ab14-4598-be4c-4d3554f5d1f3 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updated VIF entry in instance network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:07:08 user nova-compute[74959]: DEBUG nova.network.neutron [req-4f6ca583-f914-48be-9efa-eb62493abdd9 req-45cc8ee0-ab14-4598-be4c-4d3554f5d1f3 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f6ca583-f914-48be-9efa-eb62493abdd9 req-45cc8ee0-ab14-4598-be4c-4d3554f5d1f3 service nova] Releasing lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:07:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:07:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Creating image(s)
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Ensure instance console log exists: /opt/stack/data/nova/instances/0bf7ba2c-355f-4ee4-8937-ad80724df48f/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Start _get_guest_xml network_info=[{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePFtYNkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0bf7ba2c-355f-4ee4-8937-ad80724df48f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'serial': 'f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '6da47c75-7f8f-4b2d-b079-9cb0bfb698b6', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:07:14 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:07:14 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePFtYNkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:14 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:14 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:14 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e9328-b57e-479d-b1cf-21756fc5842c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:07:14 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: INFO nova.compute.manager [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Terminating instance
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6b7e31-0f0e-45e0-ae51-7bc74326d061]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d] added
Nov 28 23:07:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120b2d4-b0ff-4155-a802-8d2539573be2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4a55a-bde2-49d7-97f5-c4c754faf169]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePFtYNkg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePFtYNkg" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a2ce93-7959-4f7f-aae0-9d3e08edfe56]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePFtYNkg'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1f41ac-dc9b-45fa-9b53-c32dc3011221]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e953034-4531-4837-8ed5-9931d65f8952]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7cd94c-2a33-487c-b40e-7ed71a170881]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260]
Nov 28 23:07:14 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260] successful.
Nov 28 23:07:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0823eeb-548e-41b3-93a3-fa62bc312b0a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-77a316ee-864b-4fae-96a9-b368f2976e78 req-6a3b7325-41f9-4588-b2af-ce3d49d6f97b service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received event network-vif-unplugged-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-77a316ee-864b-4fae-96a9-b368f2976e78 req-6a3b7325-41f9-4588-b2af-ce3d49d6f97b service nova] Acquiring lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-77a316ee-864b-4fae-96a9-b368f2976e78 req-6a3b7325-41f9-4588-b2af-ce3d49d6f97b service nova] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-77a316ee-864b-4fae-96a9-b368f2976e78 req-6a3b7325-41f9-4588-b2af-ce3d49d6f97b service nova] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-77a316ee-864b-4fae-96a9-b368f2976e78 req-6a3b7325-41f9-4588-b2af-ce3d49d6f97b service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] No waiting events found dispatching network-vif-unplugged-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-77a316ee-864b-4fae-96a9-b368f2976e78 req-6a3b7325-41f9-4588-b2af-ce3d49d6f97b service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received event network-vif-unplugged-53709c08-cf21-4a56-8d9d-1b069b887dea for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4b7421-7c19-4537-8a4a-8bce86dcf06f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:14 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6887fa8a-721a-4c71-a18a-07ef871b1dc2]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:07:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePFtYNkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:07:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Instance destroyed successfully.
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.objects.instance [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lazy-loading 'resources' on Instance uuid 3fbcfd9e-bf33-4452-8a4f-8500ec54df51 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2048993786',display_name='tempest-VolumesNegativeTest-instance-2048993786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2048993786',id=20,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65b335c2c2384f1686152b556b992878',ramdisk_id='',reservation_id='r-4iz5jr2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1273793192',owner_user_name='tempest-VolumesNegativeTest-1273793192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:05:31Z,user_data=None,user_id='08e192228fa94f08bf9c5173717e958e',uuid=3fbcfd9e-bf33-4452-8a4f-8500ec54df51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Converting VIF {"id": "53709c08-cf21-4a56-8d9d-1b069b887dea", "address": "fa:16:3e:eb:2d:c1", "network": {"id": "374610b2-fd89-4df1-b002-b12e5e1b9438", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "053eec02cccb48318ff5b24f5d53167c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53709c08-cf", "ovs_interfaceid": "53709c08-cf21-4a56-8d9d-1b069b887dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=53709c08-cf21-4a56-8d9d-1b069b887dea,network=Network(374610b2-fd89-4df1-b002-b12e5e1b9438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53709c08-cf') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG os_vif [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=53709c08-cf21-4a56-8d9d-1b069b887dea,network=Network(374610b2-fd89-4df1-b002-b12e5e1b9438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53709c08-cf') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53709c08-cf, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=968c2917-6472-41c1-9e9d-e46db1c528d3) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: INFO os_vif [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:2d:c1,bridge_name='br-int',has_traffic_filtering=True,id=53709c08-cf21-4a56-8d9d-1b069b887dea,network=Network(374610b2-fd89-4df1-b002-b12e5e1b9438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53709c08-cf')
Nov 28 23:07:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Deleting instance files /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51_del
Nov 28 23:07:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Deletion of /opt/stack/data/nova/instances/3fbcfd9e-bf33-4452-8a4f-8500ec54df51_del complete
Nov 28 23:07:15 user nova-compute[74959]: INFO nova.compute.manager [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 23:07:15 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26563613532376232', 'path': '/dev/sde'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563613532376232', 'path': '/dev/sde'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1099925087',display_name='tempest-TestShelveInstance-server-1099925087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1099925087',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUpUnh16KnhRFBjgrExrRBzAPZOMbfROnxIB/QzkB4XOJ4EkaMvtcMIzGiCMrfg7Ikqsa2yKPERXntT/PzeG19u5v85fNuNBonobsX6Lu/DYlmy81bO6leef1roSi+Sug==',key_name='tempest-TestShelveInstance-1413730831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e326f1cb3b64f78b1cd0ef5adc09323',ramdisk_id='',reservation_id='r-owauny1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-19474985',owner_user_name='tempest-TestShelveInstance-19474985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:07:06Z,user_data=None,user_id='305832e59f9846b2923717725a362cbc',uuid=0bf7ba2c-355f-4ee4-8937-ad80724df48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converting VIF {"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.objects.instance [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bf7ba2c-355f-4ee4-8937-ad80724df48f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:07:15 user nova-compute[74959]:   <uuid>0bf7ba2c-355f-4ee4-8937-ad80724df48f</uuid>
Nov 28 23:07:15 user nova-compute[74959]:   <name>instance-00000018</name>
Nov 28 23:07:15 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:07:15 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:07:15 user nova-compute[74959]:   <metadata>
Nov 28 23:07:15 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:07:15 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:07:15 user nova-compute[74959]:       <nova:name>tempest-TestShelveInstance-server-1099925087</nova:name>
Nov 28 23:07:15 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:07:14</nova:creationTime>
Nov 28 23:07:15 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:07:15 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:07:15 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:07:15 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:07:15 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:07:15 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:07:15 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:07:15 user nova-compute[74959]:       <nova:owner>
Nov 28 23:07:15 user nova-compute[74959]:         <nova:user uuid="305832e59f9846b2923717725a362cbc">tempest-TestShelveInstance-19474985-project-member</nova:user>
Nov 28 23:07:15 user nova-compute[74959]:         <nova:project uuid="2e326f1cb3b64f78b1cd0ef5adc09323">tempest-TestShelveInstance-19474985</nova:project>
Nov 28 23:07:15 user nova-compute[74959]:       </nova:owner>
Nov 28 23:07:15 user nova-compute[74959]:       <nova:ports>
Nov 28 23:07:15 user nova-compute[74959]:         <nova:port uuid="8b4e208b-60ed-496c-9c2a-94a3ec2bc70f">
Nov 28 23:07:15 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:07:15 user nova-compute[74959]:         </nova:port>
Nov 28 23:07:15 user nova-compute[74959]:       </nova:ports>
Nov 28 23:07:15 user nova-compute[74959]:     </nova:instance>
Nov 28 23:07:15 user nova-compute[74959]:   </metadata>
Nov 28 23:07:15 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:07:15 user nova-compute[74959]:     <system>
Nov 28 23:07:15 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:07:15 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:07:15 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:07:15 user nova-compute[74959]:       <entry name="serial">0bf7ba2c-355f-4ee4-8937-ad80724df48f</entry>
Nov 28 23:07:15 user nova-compute[74959]:       <entry name="uuid">0bf7ba2c-355f-4ee4-8937-ad80724df48f</entry>
Nov 28 23:07:15 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:07:15 user nova-compute[74959]:     </system>
Nov 28 23:07:15 user nova-compute[74959]:   </sysinfo>
Nov 28 23:07:15 user nova-compute[74959]:   <os>
Nov 28 23:07:15 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:07:15 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:07:15 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:07:15 user nova-compute[74959]:   </os>
Nov 28 23:07:15 user nova-compute[74959]:   <features>
Nov 28 23:07:15 user nova-compute[74959]:     <acpi/>
Nov 28 23:07:15 user nova-compute[74959]:     <apic/>
Nov 28 23:07:15 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:07:15 user nova-compute[74959]:   </features>
Nov 28 23:07:15 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:07:15 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:07:15 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:07:15 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:07:15 user nova-compute[74959]:   </clock>
Nov 28 23:07:15 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:07:15 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:07:15 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:07:15 user nova-compute[74959]:   </cpu>
Nov 28 23:07:15 user nova-compute[74959]:   <devices>
Nov 28 23:07:15 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:07:15 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:07:15 user nova-compute[74959]:       <source dev="/dev/sde"/>
Nov 28 23:07:15 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:07:15 user nova-compute[74959]:       <serial>f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d</serial>
Nov 28 23:07:15 user nova-compute[74959]:     </disk>
Nov 28 23:07:15 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:07:15 user nova-compute[74959]:       <mac address="fa:16:3e:4c:d6:dd"/>
Nov 28 23:07:15 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:07:15 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:07:15 user nova-compute[74959]:       <target dev="tap8b4e208b-60"/>
Nov 28 23:07:15 user nova-compute[74959]:     </interface>
Nov 28 23:07:15 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:07:15 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/0bf7ba2c-355f-4ee4-8937-ad80724df48f/console.log" append="off"/>
Nov 28 23:07:15 user nova-compute[74959]:     </serial>
Nov 28 23:07:15 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:07:15 user nova-compute[74959]:     <video>
Nov 28 23:07:15 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:07:15 user nova-compute[74959]:     </video>
Nov 28 23:07:15 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:07:15 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:07:15 user nova-compute[74959]:     </rng>
Nov 28 23:07:15 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:07:15 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:07:15 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:07:15 user nova-compute[74959]:     </memballoon>
Nov 28 23:07:15 user nova-compute[74959]:   </devices>
Nov 28 23:07:15 user nova-compute[74959]: </domain>
Nov 28 23:07:15 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1099925087',display_name='tempest-TestShelveInstance-server-1099925087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1099925087',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUpUnh16KnhRFBjgrExrRBzAPZOMbfROnxIB/QzkB4XOJ4EkaMvtcMIzGiCMrfg7Ikqsa2yKPERXntT/PzeG19u5v85fNuNBonobsX6Lu/DYlmy81bO6leef1roSi+Sug==',key_name='tempest-TestShelveInstance-1413730831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e326f1cb3b64f78b1cd0ef5adc09323',ramdisk_id='',reservation_id='r-owauny1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-19474985',owner_user_name='tempest-TestShelveInstance-19474985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:07:06Z,user_data=None,user_id='305832e59f9846b2923717725a362cbc',uuid=0bf7ba2c-355f-4ee4-8937-ad80724df48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converting VIF {"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG os_vif [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af17fab4-b679-5d95-8d31-300f7c8e118f', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4e208b-60, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b4e208b-60, col_values=(('qos', UUID('787791ad-6093-4b44-a929-444277b489b7')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b4e208b-60, col_values=(('external_ids', {'iface-id': '8b4e208b-60ed-496c-9c2a-94a3ec2bc70f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:d6:dd', 'vm-uuid': '0bf7ba2c-355f-4ee4-8937-ad80724df48f'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:15 user nova-compute[74959]: INFO os_vif [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60')
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] No VIF found with MAC fa:16:3e:4c:d6:dd, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:16 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Took 0.63 seconds to deallocate network for instance.
Nov 28 23:07:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-6686f41f-e49b-4ac2-bced-060da2ff90d6 req-b30e0f6c-a689-427b-a3ad-ad34716b9264 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received event network-vif-deleted-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:16 user nova-compute[74959]: INFO nova.compute.manager [req-6686f41f-e49b-4ac2-bced-060da2ff90d6 req-b30e0f6c-a689-427b-a3ad-ad34716b9264 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Neutron deleted interface 53709c08-cf21-4a56-8d9d-1b069b887dea; detaching it from the instance and deleting it from the info cache
Nov 28 23:07:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-6686f41f-e49b-4ac2-bced-060da2ff90d6 req-b30e0f6c-a689-427b-a3ad-ad34716b9264 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-6686f41f-e49b-4ac2-bced-060da2ff90d6 req-b30e0f6c-a689-427b-a3ad-ad34716b9264 service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Detach interface failed, port_id=53709c08-cf21-4a56-8d9d-1b069b887dea, reason: Instance 3fbcfd9e-bf33-4452-8a4f-8500ec54df51 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-5d92acfc-375a-424a-b0d1-445063f0f1b5 req-ff2be48f-7c56-496b-a1cf-a9246e57c8ff service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received event network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5d92acfc-375a-424a-b0d1-445063f0f1b5 req-ff2be48f-7c56-496b-a1cf-a9246e57c8ff service nova] Acquiring lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5d92acfc-375a-424a-b0d1-445063f0f1b5 req-ff2be48f-7c56-496b-a1cf-a9246e57c8ff service nova] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5d92acfc-375a-424a-b0d1-445063f0f1b5 req-ff2be48f-7c56-496b-a1cf-a9246e57c8ff service nova] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-5d92acfc-375a-424a-b0d1-445063f0f1b5 req-ff2be48f-7c56-496b-a1cf-a9246e57c8ff service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] No waiting events found dispatching network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:16 user nova-compute[74959]: WARNING nova.compute.manager [req-5d92acfc-375a-424a-b0d1-445063f0f1b5 req-ff2be48f-7c56-496b-a1cf-a9246e57c8ff service nova] [instance: 3fbcfd9e-bf33-4452-8a4f-8500ec54df51] Received unexpected event network-vif-plugged-53709c08-cf21-4a56-8d9d-1b069b887dea for instance with vm_state deleted and task_state None.
Nov 28 23:07:16 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Deleted allocations for instance 3fbcfd9e-bf33-4452-8a4f-8500ec54df51
Nov 28 23:07:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cb8a5b35-5cc1-4532-91e4-6ba52033d051 tempest-VolumesNegativeTest-1273793192 tempest-VolumesNegativeTest-1273793192-project-member] Lock "3fbcfd9e-bf33-4452-8a4f-8500ec54df51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.461s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-93131359-9337-45df-a818-b5c35616b390 req-8e34ff94-13b4-40fd-bee8-357aca22d5c3 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-93131359-9337-45df-a818-b5c35616b390 req-8e34ff94-13b4-40fd-bee8-357aca22d5c3 service nova] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-93131359-9337-45df-a818-b5c35616b390 req-8e34ff94-13b4-40fd-bee8-357aca22d5c3 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-93131359-9337-45df-a818-b5c35616b390 req-8e34ff94-13b4-40fd-bee8-357aca22d5c3 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-93131359-9337-45df-a818-b5c35616b390 req-8e34ff94-13b4-40fd-bee8-357aca22d5c3 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] No waiting events found dispatching network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:17 user nova-compute[74959]: WARNING nova.compute.manager [req-93131359-9337-45df-a818-b5c35616b390 req-8e34ff94-13b4-40fd-bee8-357aca22d5c3 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received unexpected event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f for instance with vm_state building and task_state spawning.
Nov 28 23:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-27ec1fe6-84fa-4b65-b44d-e80f00b47ef3 req-efe1ae59-ec90-4908-b971-f9ed823e6294 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received event network-changed-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-27ec1fe6-84fa-4b65-b44d-e80f00b47ef3 req-efe1ae59-ec90-4908-b971-f9ed823e6294 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Refreshing instance network info cache due to event network-changed-b5cf4232-6f1a-4a52-bb84-151c4d04e12b. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-27ec1fe6-84fa-4b65-b44d-e80f00b47ef3 req-efe1ae59-ec90-4908-b971-f9ed823e6294 service nova] Acquiring lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-27ec1fe6-84fa-4b65-b44d-e80f00b47ef3 req-efe1ae59-ec90-4908-b971-f9ed823e6294 service nova] Acquired lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-27ec1fe6-84fa-4b65-b44d-e80f00b47ef3 req-efe1ae59-ec90-4908-b971-f9ed823e6294 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Refreshing network info cache for port b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-27ec1fe6-84fa-4b65-b44d-e80f00b47ef3 req-efe1ae59-ec90-4908-b971-f9ed823e6294 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Updated VIF entry in instance network info cache for port b5cf4232-6f1a-4a52-bb84-151c4d04e12b. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-27ec1fe6-84fa-4b65-b44d-e80f00b47ef3 req-efe1ae59-ec90-4908-b971-f9ed823e6294 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Updating instance_info_cache with network_info: [{"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG nova.objects.instance [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lazy-loading 'flavor' on Instance uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-27ec1fe6-84fa-4b65-b44d-e80f00b47ef3 req-efe1ae59-ec90-4908-b971-f9ed823e6294 service nova] Releasing lock "refresh_cache-ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:18 user nova-compute[74959]: INFO nova.compute.manager [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Attaching volume d85b92c4-b7f2-4b87-82e6-1d66f5b27212 to /dev/vdb
Nov 28 23:07:19 user nova-compute[74959]: DEBUG os_brick.utils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c171a18c-9299-4180-bac5-461b53e24fdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f7dd83-79cb-411a-aa1c-060a8dd6249f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[92868948-4d06-4e0f-a6ed-4c2215cab432]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b0c2b9-a05c-47f6-8aae-d4062896b87b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:07:19 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c560184-57f7-42f4-81cf-8bac399f4063]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG os_brick.utils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Updating existing volume attachment record: 17d83795-31aa-40eb-bf88-098324573a3f {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:07:19 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance spawned successfully.
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-18e8106d-32d4-4598-8444-22e5fa08537a req-6dc2e4b2-6a7b-4fd7-9820-0462d3c0decf service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18e8106d-32d4-4598-8444-22e5fa08537a req-6dc2e4b2-6a7b-4fd7-9820-0462d3c0decf service nova] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18e8106d-32d4-4598-8444-22e5fa08537a req-6dc2e4b2-6a7b-4fd7-9820-0462d3c0decf service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18e8106d-32d4-4598-8444-22e5fa08537a req-6dc2e4b2-6a7b-4fd7-9820-0462d3c0decf service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-18e8106d-32d4-4598-8444-22e5fa08537a req-6dc2e4b2-6a7b-4fd7-9820-0462d3c0decf service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] No waiting events found dispatching network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:19 user nova-compute[74959]: WARNING nova.compute.manager [req-18e8106d-32d4-4598-8444-22e5fa08537a req-6dc2e4b2-6a7b-4fd7-9820-0462d3c0decf service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received unexpected event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f for instance with vm_state building and task_state spawning.
Nov 28 23:07:19 user nova-compute[74959]: INFO nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 28 23:07:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:07:19 user nova-compute[74959]: INFO nova.compute.manager [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Took 14.58 seconds to build instance.
Nov 28 23:07:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-66aacab0-208d-4164-8ec8-9ef6aed76efa tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.692s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:07:23 user nova-compute[74959]: INFO nova.compute.claims [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Claim successful on node user
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:07:23 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:07:23 user nova-compute[74959]: DEBUG nova.policy [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73af90e11a374c9cbf0a58db8410e245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac0d1f399f040f98098e84ac875c1fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:07:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Creating image(s)
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "/opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "/opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk 1073741824" returned: 0 in 0.073s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Successfully created port: 72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Cannot resize image /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Ensure instance console log exists: /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Successfully updated port: 72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquired lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-b17d0ee5-7543-4fbd-b809-93c7d78f8191 req-1af844f6-811b-47cf-8fdb-031f440e234c service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-changed-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-b17d0ee5-7543-4fbd-b809-93c7d78f8191 req-1af844f6-811b-47cf-8fdb-031f440e234c service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Refreshing instance network info cache due to event network-changed-72a7bc36-1b60-4142-885f-33c78bb17209. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b17d0ee5-7543-4fbd-b809-93c7d78f8191 req-1af844f6-811b-47cf-8fdb-031f440e234c service nova] Acquiring lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:07:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updating instance_info_cache with network_info: [{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Releasing lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Instance network_info: |[{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b17d0ee5-7543-4fbd-b809-93c7d78f8191 req-1af844f6-811b-47cf-8fdb-031f440e234c service nova] Acquired lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-b17d0ee5-7543-4fbd-b809-93c7d78f8191 req-1af844f6-811b-47cf-8fdb-031f440e234c service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Refreshing network info cache for port 72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Start _get_guest_xml network_info=[{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:07:26 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:07:26 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1271745554',display_name='tempest-ServerActionsTestOtherA-server-1271745554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1271745554',id=25,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-wzcemom4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:07:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6a4c9cc3-e1c2-4963-8848-d52db32ae85e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:ec,bridge_name='br-int',has_traffic_filtering=True,id=72a7bc36-1b60-4142-885f-33c78bb17209,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a7bc36-1b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a4c9cc3-e1c2-4963-8848-d52db32ae85e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:07:26 user nova-compute[74959]:   <uuid>6a4c9cc3-e1c2-4963-8848-d52db32ae85e</uuid>
Nov 28 23:07:26 user nova-compute[74959]:   <name>instance-00000019</name>
Nov 28 23:07:26 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:07:26 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:07:26 user nova-compute[74959]:   <metadata>
Nov 28 23:07:26 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:07:26 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:07:26 user nova-compute[74959]:       <nova:name>tempest-ServerActionsTestOtherA-server-1271745554</nova:name>
Nov 28 23:07:26 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:07:26</nova:creationTime>
Nov 28 23:07:26 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:07:26 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:07:26 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:07:26 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:07:26 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:07:26 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:07:26 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:07:26 user nova-compute[74959]:       <nova:owner>
Nov 28 23:07:26 user nova-compute[74959]:         <nova:user uuid="73af90e11a374c9cbf0a58db8410e245">tempest-ServerActionsTestOtherA-2143945835-project-member</nova:user>
Nov 28 23:07:26 user nova-compute[74959]:         <nova:project uuid="0ac0d1f399f040f98098e84ac875c1fd">tempest-ServerActionsTestOtherA-2143945835</nova:project>
Nov 28 23:07:26 user nova-compute[74959]:       </nova:owner>
Nov 28 23:07:26 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:07:26 user nova-compute[74959]:       <nova:ports>
Nov 28 23:07:26 user nova-compute[74959]:         <nova:port uuid="72a7bc36-1b60-4142-885f-33c78bb17209">
Nov 28 23:07:26 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:07:26 user nova-compute[74959]:         </nova:port>
Nov 28 23:07:26 user nova-compute[74959]:       </nova:ports>
Nov 28 23:07:26 user nova-compute[74959]:     </nova:instance>
Nov 28 23:07:26 user nova-compute[74959]:   </metadata>
Nov 28 23:07:26 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:07:26 user nova-compute[74959]:     <system>
Nov 28 23:07:26 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:07:26 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:07:26 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:07:26 user nova-compute[74959]:       <entry name="serial">6a4c9cc3-e1c2-4963-8848-d52db32ae85e</entry>
Nov 28 23:07:26 user nova-compute[74959]:       <entry name="uuid">6a4c9cc3-e1c2-4963-8848-d52db32ae85e</entry>
Nov 28 23:07:26 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:07:26 user nova-compute[74959]:     </system>
Nov 28 23:07:26 user nova-compute[74959]:   </sysinfo>
Nov 28 23:07:26 user nova-compute[74959]:   <os>
Nov 28 23:07:26 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:07:26 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:07:26 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:07:26 user nova-compute[74959]:   </os>
Nov 28 23:07:26 user nova-compute[74959]:   <features>
Nov 28 23:07:26 user nova-compute[74959]:     <acpi/>
Nov 28 23:07:26 user nova-compute[74959]:     <apic/>
Nov 28 23:07:26 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:07:26 user nova-compute[74959]:   </features>
Nov 28 23:07:26 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:07:26 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:07:26 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:07:26 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:07:26 user nova-compute[74959]:   </clock>
Nov 28 23:07:26 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:07:26 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:07:26 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:07:26 user nova-compute[74959]:   </cpu>
Nov 28 23:07:26 user nova-compute[74959]:   <devices>
Nov 28 23:07:26 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:07:26 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:07:26 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk"/>
Nov 28 23:07:26 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:07:26 user nova-compute[74959]:     </disk>
Nov 28 23:07:26 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:07:26 user nova-compute[74959]:       <mac address="fa:16:3e:92:70:ec"/>
Nov 28 23:07:26 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:07:26 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:07:26 user nova-compute[74959]:       <target dev="tap72a7bc36-1b"/>
Nov 28 23:07:26 user nova-compute[74959]:     </interface>
Nov 28 23:07:26 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:07:26 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/console.log" append="off"/>
Nov 28 23:07:26 user nova-compute[74959]:     </serial>
Nov 28 23:07:26 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:07:26 user nova-compute[74959]:     <video>
Nov 28 23:07:26 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:07:26 user nova-compute[74959]:     </video>
Nov 28 23:07:26 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:07:26 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:07:26 user nova-compute[74959]:     </rng>
Nov 28 23:07:26 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:07:26 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:07:26 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:07:26 user nova-compute[74959]:     </memballoon>
Nov 28 23:07:26 user nova-compute[74959]:   </devices>
Nov 28 23:07:26 user nova-compute[74959]: </domain>
Nov 28 23:07:26 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1271745554',display_name='tempest-ServerActionsTestOtherA-server-1271745554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1271745554',id=25,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-wzcemom4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:07:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6a4c9cc3-e1c2-4963-8848-d52db32ae85e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:ec,bridge_name='br-int',has_traffic_filtering=True,id=72a7bc36-1b60-4142-885f-33c78bb17209,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a7bc36-1b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG os_vif [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:ec,bridge_name='br-int',has_traffic_filtering=True,id=72a7bc36-1b60-4142-885f-33c78bb17209,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a7bc36-1b') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f4cd310-6f37-5707-8564-81b87a0af3fa', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a7bc36-1b, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72a7bc36-1b, col_values=(('qos', UUID('35580598-982b-4c41-b669-a5399b4fa1c5')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72a7bc36-1b, col_values=(('external_ids', {'iface-id': '72a7bc36-1b60-4142-885f-33c78bb17209', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:70:ec', 'vm-uuid': '6a4c9cc3-e1c2-4963-8848-d52db32ae85e'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:26 user nova-compute[74959]: INFO os_vif [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:70:ec,bridge_name='br-int',has_traffic_filtering=True,id=72a7bc36-1b60-4142-885f-33c78bb17209,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a7bc36-1b')
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No VIF found with MAC fa:16:3e:92:70:ec, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-b17d0ee5-7543-4fbd-b809-93c7d78f8191 req-1af844f6-811b-47cf-8fdb-031f440e234c service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updated VIF entry in instance network info cache for port 72a7bc36-1b60-4142-885f-33c78bb17209. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-b17d0ee5-7543-4fbd-b809-93c7d78f8191 req-1af844f6-811b-47cf-8fdb-031f440e234c service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updating instance_info_cache with network_info: [{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b17d0ee5-7543-4fbd-b809-93c7d78f8191 req-1af844f6-811b-47cf-8fdb-031f440e234c service nova] Releasing lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-09b9be51-35f1-44c0-8cb1-1ee87e13f900 req-512a0def-7b40-477f-a525-234f9c789435 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received event network-changed-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-09b9be51-35f1-44c0-8cb1-1ee87e13f900 req-512a0def-7b40-477f-a525-234f9c789435 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Refreshing instance network info cache due to event network-changed-aa7ad87d-15ef-4ede-8291-2a244cded2b5. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-09b9be51-35f1-44c0-8cb1-1ee87e13f900 req-512a0def-7b40-477f-a525-234f9c789435 service nova] Acquiring lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-09b9be51-35f1-44c0-8cb1-1ee87e13f900 req-512a0def-7b40-477f-a525-234f9c789435 service nova] Acquired lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:07:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-09b9be51-35f1-44c0-8cb1-1ee87e13f900 req-512a0def-7b40-477f-a525-234f9c789435 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Refreshing network info cache for port aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBzDKePU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:27 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:27 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:27 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[df291ea5-c51f-4471-bbb4-8657605c67ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:07:27 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c62c85-88a1-4aab-8bb0-825a671071e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212] added
Nov 28 23:07:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1b2b85-3d2d-4d97-a5aa-f7d52e72724b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.124s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[393848c2-46c7-4204-8ffc-62710448a4a3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBzDKePU {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBzDKePU" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d413b52-1501-420b-b61e-703e44161596]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBzDKePU'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e511590c-aea0-4618-a43f-cf7678f16148]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[48571f9a-7a84-4a2d-911d-73985656c8d8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f82d56-66cb-4e5c-a168-16cf255b12e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212, portal: 172.16.0.220,3260]
Nov 28 23:07:27 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212, portal: 172.16.0.220,3260] successful.
Nov 28 23:07:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7196abb4-e17c-4096-be55-d95f8cad9662]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c17cc4e-1f38-478d-b180-fa4f0ca9a59f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:27 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ae4d11-8393-4616-be02-ea2c96454a99]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBzDKePU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-09b9be51-35f1-44c0-8cb1-1ee87e13f900 req-512a0def-7b40-477f-a525-234f9c789435 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Updated VIF entry in instance network info cache for port aa7ad87d-15ef-4ede-8291-2a244cded2b5. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-09b9be51-35f1-44c0-8cb1-1ee87e13f900 req-512a0def-7b40-477f-a525-234f9c789435 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Updating instance_info_cache with network_info: [{"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-09b9be51-35f1-44c0-8cb1-1ee87e13f900 req-512a0def-7b40-477f-a525-234f9c789435 service nova] Releasing lock "refresh_cache-7d4ca972-77ec-4a5c-8259-b695fba4b862" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-33fa9560-c8c9-4d73-8f8a-cc2db3628bc6 req-0abe3d81-3438-45dd-b35f-746f000882a3 service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33fa9560-c8c9-4d73-8f8a-cc2db3628bc6 req-0abe3d81-3438-45dd-b35f-746f000882a3 service nova] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33fa9560-c8c9-4d73-8f8a-cc2db3628bc6 req-0abe3d81-3438-45dd-b35f-746f000882a3 service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-33fa9560-c8c9-4d73-8f8a-cc2db3628bc6 req-0abe3d81-3438-45dd-b35f-746f000882a3 service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-33fa9560-c8c9-4d73-8f8a-cc2db3628bc6 req-0abe3d81-3438-45dd-b35f-746f000882a3 service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] No waiting events found dispatching network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:27 user nova-compute[74959]: WARNING nova.compute.manager [req-33fa9560-c8c9-4d73-8f8a-cc2db3628bc6 req-0abe3d81-3438-45dd-b35f-746f000882a3 service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received unexpected event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 for instance with vm_state building and task_state spawning.
Nov 28 23:07:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '26132396362373136', 'path': '/dev/sdf'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132396362373136', 'path': '/dev/sdf'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:07:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lazy-loading 'flavor' on Instance uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:07:28 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:07:28 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:07:28 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:07:28 user nova-compute[74959]:   <serial>d85b92c4-b7f2-4b87-82e6-1d66f5b27212</serial>
Nov 28 23:07:28 user nova-compute[74959]: </disk>
Nov 28 23:07:28 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No VIF found with MAC fa:16:3e:f3:22:ee, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-568d0975-3407-4942-a245-1ded119d2d63 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.216s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid 7d4ca972-77ec-4a5c-8259-b695fba4b862 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:29 user nova-compute[74959]: INFO nova.compute.manager [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Attaching volume a46bcf8a-d370-4f05-ae87-478faf3a0678 to /dev/vdb
Nov 28 23:07:29 user nova-compute[74959]: DEBUG os_brick.utils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49ac42-76cc-4986-b425-a66bf2c86145]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1706105-34bb-4ddd-acfc-d2e115135a3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a497b75-e9e2-4faa-bc53-9cef83577d35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c1b6a9-fe2f-4e8f-be91-66fae0ec5d4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:07:29 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:07:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a5ce22-3e1d-48a7-9408-da0ab6b4dfb1]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG os_brick.utils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Updating existing volume attachment record: 29cc0c6d-d709-4556-9769-9e598f4af38b {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:07:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:07:29 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Instance spawned successfully.
Nov 28 23:07:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-fe45e315-1e65-49d3-bcfd-d0ab5c9f0169 req-04586856-4bc0-4c53-92cd-4b619e82f9dc service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe45e315-1e65-49d3-bcfd-d0ab5c9f0169 req-04586856-4bc0-4c53-92cd-4b619e82f9dc service nova] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe45e315-1e65-49d3-bcfd-d0ab5c9f0169 req-04586856-4bc0-4c53-92cd-4b619e82f9dc service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe45e315-1e65-49d3-bcfd-d0ab5c9f0169 req-04586856-4bc0-4c53-92cd-4b619e82f9dc service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-fe45e315-1e65-49d3-bcfd-d0ab5c9f0169 req-04586856-4bc0-4c53-92cd-4b619e82f9dc service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] No waiting events found dispatching network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:30 user nova-compute[74959]: WARNING nova.compute.manager [req-fe45e315-1e65-49d3-bcfd-d0ab5c9f0169 req-04586856-4bc0-4c53-92cd-4b619e82f9dc service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received unexpected event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 for instance with vm_state building and task_state spawning.
Nov 28 23:07:30 user nova-compute[74959]: INFO nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:30 user nova-compute[74959]: INFO nova.compute.manager [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Terminating instance
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:07:30 user nova-compute[74959]: INFO nova.compute.manager [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Took 6.96 seconds to build instance.
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e3a9b9b2-c084-4ed3-a139-64f1b48ec854 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.093s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-3571d6c9-a03a-478a-9702-81b03a600667 req-a6fe94be-6d42-4702-8159-6a261bc08d0e service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3571d6c9-a03a-478a-9702-81b03a600667 req-a6fe94be-6d42-4702-8159-6a261bc08d0e service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3571d6c9-a03a-478a-9702-81b03a600667 req-a6fe94be-6d42-4702-8159-6a261bc08d0e service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3571d6c9-a03a-478a-9702-81b03a600667 req-a6fe94be-6d42-4702-8159-6a261bc08d0e service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-3571d6c9-a03a-478a-9702-81b03a600667 req-a6fe94be-6d42-4702-8159-6a261bc08d0e service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-3571d6c9-a03a-478a-9702-81b03a600667 req-a6fe94be-6d42-4702-8159-6a261bc08d0e service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-unplugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Instance destroyed successfully.
Nov 28 23:07:31 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lazy-loading 'resources' on Instance uuid 7011df2d-f2c5-48ba-8d4c-d0539c235917 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1175671381',display_name='tempest-ServerActionsTestOtherB-server-1175671381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1175671381',id=4,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlnjjjV6UBXG+UbkfFnZgTkuCyNd2SeK6lEF2FJqZtmInAceczEtf9rafvVKtpb6vg4F5Hx8w3yplQiks8hi4DEfxqKyvspFyHAk2e9OfDc3O2omDPTcofODMG9ut16Rg==',key_name='tempest-keypair-827117807',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:05:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e566d89eec64455b5bdb1b105bfe9a0',ramdisk_id='',reservation_id='r-vt0y2viv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-152667612',owner_user_name='tempest-ServerActionsTestOtherB-152667612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:05:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='911d51b00a8e442cbe38d5e511edba81',uuid=7011df2d-f2c5-48ba-8d4c-d0539c235917,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converting VIF {"id": "67663953-c88b-4b51-88e5-2904a213a0ef", "address": "fa:16:3e:b4:83:ed", "network": {"id": "43baf1ab-cb92-42aa-a329-93311800aef3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30122154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e566d89eec64455b5bdb1b105bfe9a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67663953-c8", "ovs_interfaceid": "67663953-c88b-4b51-88e5-2904a213a0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_vif [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67663953-c8, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e96fa09f-3894-44f4-a1c5-5209b71a1977) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:31 user nova-compute[74959]: INFO os_vif [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:83:ed,bridge_name='br-int',has_traffic_filtering=True,id=67663953-c88b-4b51-88e5-2904a213a0ef,network=Network(43baf1ab-cb92-42aa-a329-93311800aef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67663953-c8')
Nov 28 23:07:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGrXlNba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:31 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfbadab-2fbe-4f2a-a87f-b0dc4ef36866]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:07:31 user nova-compute[74959]: No targets found.
Nov 28 23:07:31 user nova-compute[74959]: iSNS:
Nov 28 23:07:31 user nova-compute[74959]: No targets found.
Nov 28 23:07:31 user nova-compute[74959]: STATIC:
Nov 28 23:07:31 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212
Nov 28 23:07:31 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:31 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:31 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2
Nov 28 23:07:31 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:31 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:31 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:07:31 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:31 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:31 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:07:31 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:31 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:31 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:07:31 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:31 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:31 user nova-compute[74959]: FIRMWARE:
Nov 28 23:07:31 user nova-compute[74959]: No targets found.
Nov 28 23:07:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:07:31 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:07:31 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[752348bc-1dd6-4c60-ad0a-8b40a4092ddc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d42913-07a4-4656-aeb3-33669efb622d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:31 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:31 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:31 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:31 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:31 user nova-compute[74959]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 (non-flash)
Nov 28 23:07:31 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:31 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:31 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4742440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2'): ({'sdd'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Removing single pathed devices sdd {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[146a3e7d-ba40-4180-9227-676e8984fcff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c177c9-32e7-422b-8cca-69f66b856d6b]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Flushing IO for device /dev/sdd {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b6a426-e655-49d4-b52a-1a6638ea3d71]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[579935f9-7f85-4311-b934-b07ecea984da]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[99025f66-253c-4bf7-8fb1-1a1039f1266c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8917453-3cba-4192-b7fd-c1b25a1a8cb1]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260]
Nov 28 23:07:31 user nova-compute[74959]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2, portal: 172.16.0.220,3260] successful.
Nov 28 23:07:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5e6b154-a7cf-41bf-b0c8-a559df5579b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced03cef-c5a5-4737-a6b4-422c0d15d690]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] <== disconnect_volume: return (375ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:07:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Deleting instance files /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917_del
Nov 28 23:07:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Deletion of /opt/stack/data/nova/instances/7011df2d-f2c5-48ba-8d4c-d0539c235917_del complete
Nov 28 23:07:31 user nova-compute[74959]: INFO nova.compute.manager [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 28 23:07:31 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:07:31 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:07:32 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:32 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Took 1.07 seconds to deallocate network for instance.
Nov 28 23:07:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-3587581f-953c-41a2-a1f5-1d305e5b25b3 req-48e25351-886d-4a9f-8693-dbd7ebab3c46 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3587581f-953c-41a2-a1f5-1d305e5b25b3 req-48e25351-886d-4a9f-8693-dbd7ebab3c46 service nova] Acquiring lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3587581f-953c-41a2-a1f5-1d305e5b25b3 req-48e25351-886d-4a9f-8693-dbd7ebab3c46 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3587581f-953c-41a2-a1f5-1d305e5b25b3 req-48e25351-886d-4a9f-8693-dbd7ebab3c46 service nova] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-3587581f-953c-41a2-a1f5-1d305e5b25b3 req-48e25351-886d-4a9f-8693-dbd7ebab3c46 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] No waiting events found dispatching network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:32 user nova-compute[74959]: WARNING nova.compute.manager [req-3587581f-953c-41a2-a1f5-1d305e5b25b3 req-48e25351-886d-4a9f-8693-dbd7ebab3c46 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received unexpected event network-vif-plugged-67663953-c88b-4b51-88e5-2904a213a0ef for instance with vm_state active and task_state deleting.
Nov 28 23:07:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-3542a1ca-a32f-4f11-8506-cb114512f87a req-5d463501-e30b-43d9-a4ff-b77b9d7b33b5 service nova] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Received event network-vif-deleted-67663953-c88b-4b51-88e5-2904a213a0ef {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lazy-loading 'flavor' on Instance uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.194s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:34 user nova-compute[74959]: INFO nova.compute.manager [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Attaching volume 84294687-d924-4eac-93b0-af66701b301d to /dev/vdc
Nov 28 23:07:34 user nova-compute[74959]: DEBUG os_brick.utils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68062e7-58ce-429c-8291-720171d839c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6badc037-e4aa-4cf7-8b68-fe77dbc31233]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe95c6cd-aba2-42f1-99c4-fed0cc761726]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7a789-8879-4dd9-9b7b-a6f980f3ea06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:07:34 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:07:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9428994e-b2a5-40e0-aaf3-fa924a178e2a]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG os_brick.utils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:34 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Updating existing volume attachment record: bf2a1509-2b4a-481c-82fa-6218c0dc5c8b {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:07:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:07:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Skipping network cache update for instance because it is being deleted. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 28 23:07:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:07:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:07:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:07:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [{"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-9492b249-758e-4b8f-acfb-f334ef80a9dd" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:07:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:07:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:38 user nova-compute[74959]: INFO nova.compute.manager [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] [instance: 7011df2d-f2c5-48ba-8d4c-d0539c235917] Took 6.10 seconds to detach 1 volumes for instance.
Nov 28 23:07:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPovGqfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:39 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:39 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:39 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb550ba-6bff-4288-8a4b-3410e211b05b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:07:39 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb5d17-89a2-4f76-9c78-bc8382d5ae1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678] added
Nov 28 23:07:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab78e311-4f8b-499e-9aee-0e3b3a782635]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4c560b-decd-4359-9970-1db20a47307d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPovGqfY {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPovGqfY" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9aed98-f318-4faf-8b2f-20bd088cf2a9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPovGqfY'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04c9c4c-7496-48d8-bd00-e36ddadb644e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Deleted allocations for instance 7011df2d-f2c5-48ba-8d4c-d0539c235917
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3ab475-22f7-4f55-a501-cb2c221cbd61]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2c4fd95f-957f-4d26-851e-ec9f0349da0f tempest-ServerActionsTestOtherB-152667612 tempest-ServerActionsTestOtherB-152667612-project-member] Lock "7011df2d-f2c5-48ba-8d4c-d0539c235917" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.170s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[577b4025-dc29-4a81-81ef-483d18469bdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678, portal: 172.16.0.220,3260]
Nov 28 23:07:39 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678, portal: 172.16.0.220,3260] successful.
Nov 28 23:07:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ca70a5-a280-4dd3-98d0-e39aba1774b9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be4ae98-8aab-4451-9311-46cc33a2c67c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:07:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8896b2a-c271-400a-9e52-79e1d32bd8ad]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPovGqfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:07:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23435336236386165', 'path': '/dev/sdd'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435336236386165', 'path': '/dev/sdd'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid 7d4ca972-77ec-4a5c-8259-b695fba4b862 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:07:40 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:07:40 user nova-compute[74959]:   <source dev="/dev/sdd"/>
Nov 28 23:07:40 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:07:40 user nova-compute[74959]:   <serial>a46bcf8a-d370-4f05-ae87-478faf3a0678</serial>
Nov 28 23:07:40 user nova-compute[74959]: </disk>
Nov 28 23:07:40 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No VIF found with MAC fa:16:3e:d7:15:36, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdc6d39f-2ed2-428a-8dd4-d48fc18fc512 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.492s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:42 user nova-compute[74959]: INFO nova.compute.manager [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Detaching volume a46bcf8a-d370-4f05-ae87-478faf3a0678
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:42 user nova-compute[74959]: INFO nova.virt.block_device [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Attempting to driver detach volume a46bcf8a-d370-4f05-ae87-478faf3a0678 from mountpoint /dev/vdb
Nov 28 23:07:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Attempting to detach device vdb from instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:07:42 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:07:42 user nova-compute[74959]:   <source dev="/dev/sdd"/>
Nov 28 23:07:42 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:07:42 user nova-compute[74959]:   <serial>a46bcf8a-d370-4f05-ae87-478faf3a0678</serial>
Nov 28 23:07:42 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:07:42 user nova-compute[74959]: </disk>
Nov 28 23:07:42 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:07:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully detached device vdb from instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 from the persistent domain config.
Nov 28 23:07:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:07:42 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:07:42 user nova-compute[74959]:   <source dev="/dev/sdd"/>
Nov 28 23:07:42 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:07:42 user nova-compute[74959]:   <serial>a46bcf8a-d370-4f05-ae87-478faf3a0678</serial>
Nov 28 23:07:42 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:07:42 user nova-compute[74959]: </disk>
Nov 28 23:07:42 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgoPNGKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:42 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:42 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:42 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f45bc1-866a-42d7-917f-9458cda52e6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:07:42 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e540404a-fa77-4423-aa72-a45c3e1a2888]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d] added
Nov 28 23:07:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f32b7-0e0f-4d53-9e24-caf9173d61a2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e4ebd-cfd1-410d-b613-e6948a59d556]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgoPNGKk {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgoPNGKk" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c42065-6b03-4d97-b4f8-3efece785dae]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgoPNGKk'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eda0594-b618-4ff9-8960-816d856c2e66]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da727d-6258-4732-900b-f6c0d6474998]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4095e0e2-f118-4e3b-a955-026f183b845a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d, portal: 172.16.0.220,3260]
Nov 28 23:07:43 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d, portal: 172.16.0.220,3260] successful.
Nov 28 23:07:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c29c44-f1f2-4f6e-97e0-bbcc9b2c0628]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32109b2-9fc3-4173-862f-ee0c50a56796]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)
Nov 28 23:07:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:07:43 user nova-compute[74959]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)
Nov 28 23:07:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f655728-1b1a-4d49-b218-04ece7eef168]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgoPNGKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:43 user nova-compute[74959]: INFO nova.compute.manager [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Terminating instance
Nov 28 23:07:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-b35adc49-83f3-4a69-822b-595c7b38a6f3 req-eed1fd2d-6edd-4911-9ae6-d430834ac013 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-unplugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b35adc49-83f3-4a69-822b-595c7b38a6f3 req-eed1fd2d-6edd-4911-9ae6-d430834ac013 service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b35adc49-83f3-4a69-822b-595c7b38a6f3 req-eed1fd2d-6edd-4911-9ae6-d430834ac013 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b35adc49-83f3-4a69-822b-595c7b38a6f3 req-eed1fd2d-6edd-4911-9ae6-d430834ac013 service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-b35adc49-83f3-4a69-822b-595c7b38a6f3 req-eed1fd2d-6edd-4911-9ae6-d430834ac013 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] No waiting events found dispatching network-vif-unplugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-b35adc49-83f3-4a69-822b-595c7b38a6f3 req-eed1fd2d-6edd-4911-9ae6-d430834ac013 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-unplugged-5ced9d93-efc5-4031-8356-265e81b5884f for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23436663134323065', 'path': '/dev/sdg'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436663134323065', 'path': '/dev/sdg'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lazy-loading 'flavor' on Instance uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:44 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Instance destroyed successfully.
Nov 28 23:07:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lazy-loading 'resources' on Instance uuid e1174ec3-4ec5-4538-b304-60c76ec41bc8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-89980862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1082676943',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqlpUARw/Tw9Nep95ScVmpCyPLJQOmSxAF1Y8ckwlsqtwT3jkaO4sDEsT0fDyaLML9r92WMny0erSsnO6MqU3oYNLrvO04b6VpEa5izHmhsvTDkh8uyrgG5eXNd00UpqQ==',key_name='tempest-keypair-1243684358',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40c538561f8446748937abce99e7eddf',ramdisk_id='',reservation_id='r-psdni240',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-95008496',owner_user_name='tempest-ServerActionsV293TestJSON-95008496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:06:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a20b8445a0a744588f59526545b4bc95',uuid=e1174ec3-4ec5-4538-b304-60c76ec41bc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converting VIF {"id": "5ced9d93-efc5-4031-8356-265e81b5884f", "address": "fa:16:3e:e5:8a:f2", "network": {"id": "4e717644-8670-4645-8904-e62440f80c73", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1069705327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c538561f8446748937abce99e7eddf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ced9d93-ef", "ovs_interfaceid": "5ced9d93-efc5-4031-8356-265e81b5884f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_vif [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ced9d93-ef, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=453eea89-e849-48d2-8b0f-02d8543a8206) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:07:44 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:07:44 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:07:44 user nova-compute[74959]:   <target dev="vdc" bus="virtio"/>
Nov 28 23:07:44 user nova-compute[74959]:   <serial>84294687-d924-4eac-93b0-af66701b301d</serial>
Nov 28 23:07:44 user nova-compute[74959]: </disk>
Nov 28 23:07:44 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:07:44 user nova-compute[74959]: INFO os_vif [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:f2,bridge_name='br-int',has_traffic_filtering=True,id=5ced9d93-efc5-4031-8356-265e81b5884f,network=Network(4e717644-8670-4645-8904-e62440f80c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ced9d93-ef')
Nov 28 23:07:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAzQlyCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:07:44 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614bbde-3b9c-4b08-a774-eb9d37587f29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:07:44 user nova-compute[74959]: No targets found.
Nov 28 23:07:44 user nova-compute[74959]: iSNS:
Nov 28 23:07:44 user nova-compute[74959]: No targets found.
Nov 28 23:07:44 user nova-compute[74959]: STATIC:
Nov 28 23:07:44 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212
Nov 28 23:07:44 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:44 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:44 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:07:44 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:44 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:44 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d
Nov 28 23:07:44 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:44 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:44 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:07:44 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:44 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:44 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678
Nov 28 23:07:44 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:44 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:44 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f
Nov 28 23:07:44 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:07:44 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:07:44 user nova-compute[74959]: FIRMWARE:
Nov 28 23:07:44 user nova-compute[74959]: No targets found.
Nov 28 23:07:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:07:44 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:07:44 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[577c0a77-6c6e-47a4-affb-fdb512982a41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e354694a-1fb5-4d6b-bfb2-b08ac92a4e8e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)
Nov 28 23:07:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:07:44 user nova-compute[74959]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)
Nov 28 23:07:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc583ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec572f3-39ce-4d1a-910c-e1b6413e4a58]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796a699-cb26-4027-adce-19b453fe64c3]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:45 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:07:45 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.313968658447266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c36d61-6a92-453d-9baa-d99b2aee5a57]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] No VIF found with MAC fa:16:3e:f3:22:ee, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d480c7d-5bdd-4edb-94e6-7a4f2530d35f]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eedecc-88e9-4b82-b2f4-b53bbd343c07]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f60bb-421f-4773-9716-834e3bfff9af]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260]
Nov 28 23:07:45 user nova-compute[74959]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f, portal: 172.16.0.220,3260] successful.
Nov 28 23:07:45 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e1174ec3-4ec5-4538-b304-60c76ec41bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance f180b6b0-ff56-4d28-9a5d-06244e04c1f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 0bf7ba2c-355f-4ee4-8937-ad80724df48f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858e5775-3686-4c19-b158-a2019e464c3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92d7376-d5a0-438e-a320-c75802542959]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.932s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] <== disconnect_volume: return (934ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:07:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Deleting instance files /opt/stack/data/nova/instances/e1174ec3-4ec5-4538-b304-60c76ec41bc8_del
Nov 28 23:07:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Deletion of /opt/stack/data/nova/instances/e1174ec3-4ec5-4538-b304-60c76ec41bc8_del complete
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2e44542b-df3d-4b55-afa5-8aaba58a729d tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.773s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:45 user nova-compute[74959]: INFO nova.compute.manager [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Took 1.90 seconds to destroy the instance on the hypervisor.
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-6ab36bb5-035e-4deb-a674-36f9fe0a9c5a req-62bdffeb-1aae-43ef-9e15-e5abb823851e service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6ab36bb5-035e-4deb-a674-36f9fe0a9c5a req-62bdffeb-1aae-43ef-9e15-e5abb823851e service nova] Acquiring lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6ab36bb5-035e-4deb-a674-36f9fe0a9c5a req-62bdffeb-1aae-43ef-9e15-e5abb823851e service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6ab36bb5-035e-4deb-a674-36f9fe0a9c5a req-62bdffeb-1aae-43ef-9e15-e5abb823851e service nova] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-6ab36bb5-035e-4deb-a674-36f9fe0a9c5a req-62bdffeb-1aae-43ef-9e15-e5abb823851e service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] No waiting events found dispatching network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:07:45 user nova-compute[74959]: WARNING nova.compute.manager [req-6ab36bb5-035e-4deb-a674-36f9fe0a9c5a req-62bdffeb-1aae-43ef-9e15-e5abb823851e service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received unexpected event network-vif-plugged-5ced9d93-efc5-4031-8356-265e81b5884f for instance with vm_state active and task_state deleting.
Nov 28 23:07:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:46 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-382d1ece-d323-4a28-9a49-672cad4dc018 req-24be3526-8572-4cb0-a2d9-1594a2511797 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Received event network-vif-deleted-5ced9d93-efc5-4031-8356-265e81b5884f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:07:46 user nova-compute[74959]: INFO nova.compute.manager [req-382d1ece-d323-4a28-9a49-672cad4dc018 req-24be3526-8572-4cb0-a2d9-1594a2511797 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Neutron deleted interface 5ced9d93-efc5-4031-8356-265e81b5884f; detaching it from the instance and deleting it from the info cache
Nov 28 23:07:46 user nova-compute[74959]: DEBUG nova.network.neutron [req-382d1ece-d323-4a28-9a49-672cad4dc018 req-24be3526-8572-4cb0-a2d9-1594a2511797 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:07:46 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Took 0.89 seconds to deallocate network for instance.
Nov 28 23:07:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-382d1ece-d323-4a28-9a49-672cad4dc018 req-24be3526-8572-4cb0-a2d9-1594a2511797 service nova] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Detach interface failed, port_id=5ced9d93-efc5-4031-8356-265e81b5884f, reason: Instance e1174ec3-4ec5-4538-b304-60c76ec41bc8 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:07:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:07:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:47 user nova-compute[74959]: INFO nova.compute.manager [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Detaching volume 84294687-d924-4eac-93b0-af66701b301d
Nov 28 23:07:47 user nova-compute[74959]: INFO nova.virt.block_device [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Attempting to driver detach volume 84294687-d924-4eac-93b0-af66701b301d from mountpoint /dev/vdc
Nov 28 23:07:47 user nova-compute[74959]: INFO nova.compute.manager [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Took 0.74 seconds to detach 1 volumes for instance.
Nov 28 23:07:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] [instance: e1174ec3-4ec5-4538-b304-60c76ec41bc8] Deleting volume: 858e5775-3686-4c19-b158-a2019e464c3f {{(pid=74959) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Attempting to detach device vdc from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:07:47 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:07:47 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:07:47 user nova-compute[74959]:   <target dev="vdc" bus="virtio"/>
Nov 28 23:07:47 user nova-compute[74959]:   <serial>84294687-d924-4eac-93b0-af66701b301d</serial>
Nov 28 23:07:47 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 23:07:47 user nova-compute[74959]: </disk>
Nov 28 23:07:47 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:07:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Successfully detached device vdc from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c from the persistent domain config.
Nov 28 23:07:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:07:47 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:07:47 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:07:47 user nova-compute[74959]:   <target dev="vdc" bus="virtio"/>
Nov 28 23:07:47 user nova-compute[74959]:   <serial>84294687-d924-4eac-93b0-af66701b301d</serial>
Nov 28 23:07:47 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 23:07:47 user nova-compute[74959]: </disk>
Nov 28 23:07:47 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:07:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:47 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Deleted allocations for instance e1174ec3-4ec5-4538-b304-60c76ec41bc8
Nov 28 23:07:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1ef0a062-0589-4880-925c-fd71d5b31168 tempest-ServerActionsV293TestJSON-95008496 tempest-ServerActionsV293TestJSON-95008496-project-member] Lock "e1174ec3-4ec5-4538-b304-60c76ec41bc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.261s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:07:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:07:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:03 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 is timed out.
Nov 28 23:08:03 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully detached device vdb from instance 7d4ca972-77ec-4a5c-8259-b695fba4b862 from the live domain config.
Nov 28 23:08:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPovGqfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:08:03 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f31d2a4-85f2-4103-9818-edfc74c7ea51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:08:03 user nova-compute[74959]: No targets found.
Nov 28 23:08:03 user nova-compute[74959]: iSNS:
Nov 28 23:08:03 user nova-compute[74959]: No targets found.
Nov 28 23:08:03 user nova-compute[74959]: STATIC:
Nov 28 23:08:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212
Nov 28 23:08:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:08:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d
Nov 28 23:08:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:08:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678
Nov 28 23:08:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:03 user nova-compute[74959]: FIRMWARE:
Nov 28 23:08:03 user nova-compute[74959]: No targets found.
Nov 28 23:08:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:08:03 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:08:03 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7702ca2-a3ab-4834-8307-03c98b4c8cf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0123e4-012b-48c9-8b5e-2e1d119f6cef]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:08:03 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:08:03 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:08:03 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:08:03 user nova-compute[74959]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)
Nov 28 23:08:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:08:03 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:08:03 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:08:03 user nova-compute[74959]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 (non-flash)
Nov 28 23:08:03 user nova-compute[74959]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)
Nov 28 23:08:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4219cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678'): ({'sdd'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Removing single pathed devices sdd {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f36b778-6dda-4790-809c-a723b04881d2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe62df6-2277-4f70-8da6-25b4ffa92c0e]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flushing IO for device /dev/sdd {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd51a3-7e4a-4559-bc89-4f6e1de11ccb]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6fec36-dcd7-4057-bf59-d6478d3b97a5]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[302592e3-3884-475b-828e-e549993e5897]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e45d587-dca3-4cdb-89cd-dfcdf065da2f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678, portal: 172.16.0.220,3260]
Nov 28 23:08:03 user nova-compute[74959]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678, portal: 172.16.0.220,3260] successful.
Nov 28 23:08:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a46bcf8a-d370-4f05-ae87-478faf3a0678 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fb15bd-c417-4b24-a210-3ce7c0973947]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== disconnect_volume: return (320ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-e217a6d7-1a22-4f51-b742-c42c66c7c152 req-88def36d-fbe5-4131-bd7a-a4de7a11e10b service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-changed-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-e217a6d7-1a22-4f51-b742-c42c66c7c152 req-88def36d-fbe5-4131-bd7a-a4de7a11e10b service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Refreshing instance network info cache due to event network-changed-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e217a6d7-1a22-4f51-b742-c42c66c7c152 req-88def36d-fbe5-4131-bd7a-a4de7a11e10b service nova] Acquiring lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e217a6d7-1a22-4f51-b742-c42c66c7c152 req-88def36d-fbe5-4131-bd7a-a4de7a11e10b service nova] Acquired lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-e217a6d7-1a22-4f51-b742-c42c66c7c152 req-88def36d-fbe5-4131-bd7a-a4de7a11e10b service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Refreshing network info cache for port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:08:04 user nova-compute[74959]: DEBUG nova.objects.instance [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid 7d4ca972-77ec-4a5c-8259-b695fba4b862 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:04 user nova-compute[74959]: DEBUG nova.network.neutron [req-e217a6d7-1a22-4f51-b742-c42c66c7c152 req-88def36d-fbe5-4131-bd7a-a4de7a11e10b service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updated VIF entry in instance network info cache for port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:08:04 user nova-compute[74959]: DEBUG nova.network.neutron [req-e217a6d7-1a22-4f51-b742-c42c66c7c152 req-88def36d-fbe5-4131-bd7a-a4de7a11e10b service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e217a6d7-1a22-4f51-b742-c42c66c7c152 req-88def36d-fbe5-4131-bd7a-a4de7a11e10b service nova] Releasing lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb64214e-c4eb-424f-9517-e7e5f9fa3a94 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.823s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:08:06 user nova-compute[74959]: INFO nova.compute.claims [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Claim successful on node user
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:08:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:08:06 user nova-compute[74959]: DEBUG nova.policy [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8d218abbe14f27b754f1fffd9553f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da22f0050e34c9b9a7658f16c08f28b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:08:07 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Creating image(s)
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "/opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "/opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk 1073741824" returned: 0 in 0.067s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Successfully created port: 6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:07 user nova-compute[74959]: INFO nova.compute.manager [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Shelving
Nov 28 23:08:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c is timed out.
Nov 28 23:08:07 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Successfully detached device vdc from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c from the live domain config.
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgoPNGKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:08:07 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7336bb-e077-4b2a-a983-f496cec0c502]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:08:07 user nova-compute[74959]: No targets found.
Nov 28 23:08:07 user nova-compute[74959]: iSNS:
Nov 28 23:08:07 user nova-compute[74959]: No targets found.
Nov 28 23:08:07 user nova-compute[74959]: STATIC:
Nov 28 23:08:07 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212
Nov 28 23:08:07 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:07 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:07 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:08:07 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:07 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:07 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d
Nov 28 23:08:07 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:07 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:07 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:08:07 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:07 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:07 user nova-compute[74959]: FIRMWARE:
Nov 28 23:08:07 user nova-compute[74959]: No targets found.
Nov 28 23:08:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:08:07 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:08:07 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9c38f4-df83-4f46-9ea6-a3b96dc4725a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9386350-299e-45d4-ab82-63f9b16fa271]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:08:07 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:08:07 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:08:07 user nova-compute[74959]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)
Nov 28 23:08:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:08:07 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:08:07 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:08:07 user nova-compute[74959]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d (non-flash)
Nov 28 23:08:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef429ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d'): ({'sdg'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Removing single pathed devices sdg {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21d206f-19a5-4e59-97a1-03a215a79a16]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Cannot resize image /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Ensure instance console log exists: /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7029b2b-93c0-411d-9162-d234073ce220]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Flushing IO for device /dev/sdg {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a932c-d52a-4b3e-ae8d-bdd9e7697612]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[615bab90-24bb-45fd-8eba-b42400fbb625]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-26d81796-3c34-4556-a091-ca67eb9cd74a req-a9d90b14-fedf-4fea-beff-acba1e61f342 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-unplugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-26d81796-3c34-4556-a091-ca67eb9cd74a req-a9d90b14-fedf-4fea-beff-acba1e61f342 service nova] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-26d81796-3c34-4556-a091-ca67eb9cd74a req-a9d90b14-fedf-4fea-beff-acba1e61f342 service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-26d81796-3c34-4556-a091-ca67eb9cd74a req-a9d90b14-fedf-4fea-beff-acba1e61f342 service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-26d81796-3c34-4556-a091-ca67eb9cd74a req-a9d90b14-fedf-4fea-beff-acba1e61f342 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] No waiting events found dispatching network-vif-unplugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:07 user nova-compute[74959]: WARNING nova.compute.manager [req-26d81796-3c34-4556-a091-ca67eb9cd74a req-a9d90b14-fedf-4fea-beff-acba1e61f342 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received unexpected event network-vif-unplugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f for instance with vm_state active and task_state shelving.
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6412f959-2196-4fcf-83dd-ad158976846f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef42225-129b-4e7e-889f-5617fa5a26a1]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d, portal: 172.16.0.220,3260]
Nov 28 23:08:08 user nova-compute[74959]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d, portal: 172.16.0.220,3260] successful.
Nov 28 23:08:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84294687-d924-4eac-93b0-af66701b301d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d469a099-764f-411c-9d58-7a53fd7da3d4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] <== disconnect_volume: return (340ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:08:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance destroyed successfully.
Nov 28 23:08:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Beginning cold snapshot process
Nov 28 23:08:08 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Successfully updated port: 6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "refresh_cache-6fec8c4d-2054-434e-b869-3f42ba7233c2" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquired lock "refresh_cache-6fec8c4d-2054-434e-b869-3f42ba7233c2" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk /opt/stack/data/nova/instances/snapshots/tmpeh1y4vwu/628863c666914799842b8b310d2619be {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:08 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Updating instance_info_cache with network_info: [{"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lazy-loading 'flavor' on Instance uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Releasing lock "refresh_cache-6fec8c4d-2054-434e-b869-3f42ba7233c2" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Instance network_info: |[{"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Start _get_guest_xml network_info=[{"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:08:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:08:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:08:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f89595b8-b79d-48c9-86f9-0e9b86b40457 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.123s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-601596130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-601596130',id=26,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-6u4u6025',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:08:07Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=6fec8c4d-2054-434e-b869-3f42ba7233c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:f6,bridge_name='br-int',has_traffic_filtering=True,id=6f96a6be-156c-46df-bf7b-65e447d98df3,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f96a6be-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fec8c4d-2054-434e-b869-3f42ba7233c2 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:08:09 user nova-compute[74959]:   <uuid>6fec8c4d-2054-434e-b869-3f42ba7233c2</uuid>
Nov 28 23:08:09 user nova-compute[74959]:   <name>instance-0000001a</name>
Nov 28 23:08:09 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:08:09 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:08:09 user nova-compute[74959]:   <metadata>
Nov 28 23:08:09 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:08:09 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:08:09 user nova-compute[74959]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-601596130</nova:name>
Nov 28 23:08:09 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:08:09</nova:creationTime>
Nov 28 23:08:09 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:08:09 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:08:09 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:08:09 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:08:09 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:08:09 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:08:09 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:08:09 user nova-compute[74959]:       <nova:owner>
Nov 28 23:08:09 user nova-compute[74959]:         <nova:user uuid="5a8d218abbe14f27b754f1fffd9553f8">tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member</nova:user>
Nov 28 23:08:09 user nova-compute[74959]:         <nova:project uuid="8da22f0050e34c9b9a7658f16c08f28b">tempest-ServerBootFromVolumeStableRescueTest-1156029205</nova:project>
Nov 28 23:08:09 user nova-compute[74959]:       </nova:owner>
Nov 28 23:08:09 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:08:09 user nova-compute[74959]:       <nova:ports>
Nov 28 23:08:09 user nova-compute[74959]:         <nova:port uuid="6f96a6be-156c-46df-bf7b-65e447d98df3">
Nov 28 23:08:09 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:08:09 user nova-compute[74959]:         </nova:port>
Nov 28 23:08:09 user nova-compute[74959]:       </nova:ports>
Nov 28 23:08:09 user nova-compute[74959]:     </nova:instance>
Nov 28 23:08:09 user nova-compute[74959]:   </metadata>
Nov 28 23:08:09 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:08:09 user nova-compute[74959]:     <system>
Nov 28 23:08:09 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:08:09 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:08:09 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:08:09 user nova-compute[74959]:       <entry name="serial">6fec8c4d-2054-434e-b869-3f42ba7233c2</entry>
Nov 28 23:08:09 user nova-compute[74959]:       <entry name="uuid">6fec8c4d-2054-434e-b869-3f42ba7233c2</entry>
Nov 28 23:08:09 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:08:09 user nova-compute[74959]:     </system>
Nov 28 23:08:09 user nova-compute[74959]:   </sysinfo>
Nov 28 23:08:09 user nova-compute[74959]:   <os>
Nov 28 23:08:09 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:08:09 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:08:09 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:08:09 user nova-compute[74959]:   </os>
Nov 28 23:08:09 user nova-compute[74959]:   <features>
Nov 28 23:08:09 user nova-compute[74959]:     <acpi/>
Nov 28 23:08:09 user nova-compute[74959]:     <apic/>
Nov 28 23:08:09 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:08:09 user nova-compute[74959]:   </features>
Nov 28 23:08:09 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:08:09 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:08:09 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:08:09 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:08:09 user nova-compute[74959]:   </clock>
Nov 28 23:08:09 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:08:09 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:08:09 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:08:09 user nova-compute[74959]:   </cpu>
Nov 28 23:08:09 user nova-compute[74959]:   <devices>
Nov 28 23:08:09 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:08:09 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:08:09 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk"/>
Nov 28 23:08:09 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:08:09 user nova-compute[74959]:     </disk>
Nov 28 23:08:09 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:08:09 user nova-compute[74959]:       <mac address="fa:16:3e:f5:c0:f6"/>
Nov 28 23:08:09 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:08:09 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:08:09 user nova-compute[74959]:       <target dev="tap6f96a6be-15"/>
Nov 28 23:08:09 user nova-compute[74959]:     </interface>
Nov 28 23:08:09 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:08:09 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/console.log" append="off"/>
Nov 28 23:08:09 user nova-compute[74959]:     </serial>
Nov 28 23:08:09 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:08:09 user nova-compute[74959]:     <video>
Nov 28 23:08:09 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:08:09 user nova-compute[74959]:     </video>
Nov 28 23:08:09 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:08:09 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:08:09 user nova-compute[74959]:     </rng>
Nov 28 23:08:09 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:08:09 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:08:09 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:08:09 user nova-compute[74959]:     </memballoon>
Nov 28 23:08:09 user nova-compute[74959]:   </devices>
Nov 28 23:08:09 user nova-compute[74959]: </domain>
Nov 28 23:08:09 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-601596130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-601596130',id=26,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-6u4u6025',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:08:07Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=6fec8c4d-2054-434e-b869-3f42ba7233c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:f6,bridge_name='br-int',has_traffic_filtering=True,id=6f96a6be-156c-46df-bf7b-65e447d98df3,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f96a6be-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG os_vif [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:f6,bridge_name='br-int',has_traffic_filtering=True,id=6f96a6be-156c-46df-bf7b-65e447d98df3,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f96a6be-15') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43f338e4-cf11-53ed-80df-ac524673af11', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f96a6be-15, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f96a6be-15, col_values=(('qos', UUID('ed643f2a-bd10-4fc5-949a-ac6fad6553da')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f96a6be-15, col_values=(('external_ids', {'iface-id': '6f96a6be-156c-46df-bf7b-65e447d98df3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c0:f6', 'vm-uuid': '6fec8c4d-2054-434e-b869-3f42ba7233c2'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:09 user nova-compute[74959]: INFO os_vif [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:f6,bridge_name='br-int',has_traffic_filtering=True,id=6f96a6be-156c-46df-bf7b-65e447d98df3,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f96a6be-15')
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No VIF found with MAC fa:16:3e:f5:c0:f6, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:08:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk /opt/stack/data/nova/instances/snapshots/tmpeh1y4vwu/628863c666914799842b8b310d2619be" returned: 0 in 0.730s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:09 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Snapshot extracted, beginning image upload
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] No waiting events found dispatching network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:10 user nova-compute[74959]: WARNING nova.compute.manager [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received unexpected event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received event network-changed-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Refreshing instance network info cache due to event network-changed-6f96a6be-156c-46df-bf7b-65e447d98df3. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] Acquiring lock "refresh_cache-6fec8c4d-2054-434e-b869-3f42ba7233c2" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] Acquired lock "refresh_cache-6fec8c4d-2054-434e-b869-3f42ba7233c2" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.network.neutron [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Refreshing network info cache for port 6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.network.neutron [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Updated VIF entry in instance network info cache for port 6f96a6be-156c-46df-bf7b-65e447d98df3. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.network.neutron [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Updating instance_info_cache with network_info: [{"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-05a17cd3-4e7b-4ff0-a740-78ccfae26d90 req-d422bffd-7b67-4492-9982-961e4edbb57e service nova] Releasing lock "refresh_cache-6fec8c4d-2054-434e-b869-3f42ba7233c2" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-7d64bbe0-3181-4c86-8c25-0db3b1a2c109 req-0b9ed7ba-0f20-4898-b740-dba3cedf4126 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received event network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7d64bbe0-3181-4c86-8c25-0db3b1a2c109 req-0b9ed7ba-0f20-4898-b740-dba3cedf4126 service nova] Acquiring lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7d64bbe0-3181-4c86-8c25-0db3b1a2c109 req-0b9ed7ba-0f20-4898-b740-dba3cedf4126 service nova] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7d64bbe0-3181-4c86-8c25-0db3b1a2c109 req-0b9ed7ba-0f20-4898-b740-dba3cedf4126 service nova] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-7d64bbe0-3181-4c86-8c25-0db3b1a2c109 req-0b9ed7ba-0f20-4898-b740-dba3cedf4126 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] No waiting events found dispatching network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:10 user nova-compute[74959]: WARNING nova.compute.manager [req-7d64bbe0-3181-4c86-8c25-0db3b1a2c109 req-0b9ed7ba-0f20-4898-b740-dba3cedf4126 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received unexpected event network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 for instance with vm_state building and task_state spawning.
Nov 28 23:08:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Snapshot image upload complete
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:08:12 user nova-compute[74959]: INFO nova.compute.manager [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Shelve offloading
Nov 28 23:08:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance destroyed successfully.
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquired lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-782ad24c-f8c7-49ba-8fec-8ff28c3934c7 req-2a9236ce-c8b4-494f-89a9-cdc5e8152985 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received event network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-782ad24c-f8c7-49ba-8fec-8ff28c3934c7 req-2a9236ce-c8b4-494f-89a9-cdc5e8152985 service nova] Acquiring lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-782ad24c-f8c7-49ba-8fec-8ff28c3934c7 req-2a9236ce-c8b4-494f-89a9-cdc5e8152985 service nova] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-782ad24c-f8c7-49ba-8fec-8ff28c3934c7 req-2a9236ce-c8b4-494f-89a9-cdc5e8152985 service nova] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-782ad24c-f8c7-49ba-8fec-8ff28c3934c7 req-2a9236ce-c8b4-494f-89a9-cdc5e8152985 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] No waiting events found dispatching network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:12 user nova-compute[74959]: WARNING nova.compute.manager [req-782ad24c-f8c7-49ba-8fec-8ff28c3934c7 req-2a9236ce-c8b4-494f-89a9-cdc5e8152985 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received unexpected event network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 for instance with vm_state building and task_state spawning.
Nov 28 23:08:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Instance spawned successfully.
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:13 user nova-compute[74959]: INFO nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:08:13 user nova-compute[74959]: INFO nova.compute.manager [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Took 6.87 seconds to build instance.
Nov 28 23:08:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d55f5654-a324-4cd1-81a8-9ac5e1c25092 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.967s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Releasing lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance destroyed successfully.
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.objects.instance [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'resources' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1977703593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1977703593',id=23,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkxFFQQKBAfO/SApxPbwX9zAeEyNRaEAPAtbyW3Oh1BR8HoVfkbWwsOsLh2Q+1UuVyy640UwC+mHWtb8lnf6GLZY7z1dyYQrviUMet94Y7CLHS0p/0tiqszkHln2EXlA==',key_name='tempest-keypair-488060459',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-gphxhirs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member',shelved_at='2023-11-28T23:08:12.632150',shelved_host='user',shelved_image_id='45862211-64b2-4fa5-ae24-c8dc7d9926a4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=f180b6b0-ff56-4d28-9a5d-06244e04c1f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG os_vif [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe6d4f6a-61, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-aab46476-0774-47d4-839f-b0a4cb1008ce req-4ca00e5d-13e3-49cb-bdb8-f73b9b9c3071 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-changed-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-aab46476-0774-47d4-839f-b0a4cb1008ce req-4ca00e5d-13e3-49cb-bdb8-f73b9b9c3071 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Refreshing instance network info cache due to event network-changed-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-aab46476-0774-47d4-839f-b0a4cb1008ce req-4ca00e5d-13e3-49cb-bdb8-f73b9b9c3071 service nova] Acquiring lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-aab46476-0774-47d4-839f-b0a4cb1008ce req-4ca00e5d-13e3-49cb-bdb8-f73b9b9c3071 service nova] Acquired lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-aab46476-0774-47d4-839f-b0a4cb1008ce req-4ca00e5d-13e3-49cb-bdb8-f73b9b9c3071 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Refreshing network info cache for port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb2d0b0e-632a-4f98-873a-32380511e5e8) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:13 user nova-compute[74959]: INFO os_vif [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61')
Nov 28 23:08:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Deleting instance files /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5_del
Nov 28 23:08:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Deletion of /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5_del complete
Nov 28 23:08:13 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Deleted allocations for instance f180b6b0-ff56-4d28-9a5d-06244e04c1f5
Nov 28 23:08:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG nova.objects.instance [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'numa_topology' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG nova.objects.base [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<f180b6b0-ff56-4d28-9a5d-06244e04c1f5> lazy-loaded attributes: resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-aab46476-0774-47d4-839f-b0a4cb1008ce req-4ca00e5d-13e3-49cb-bdb8-f73b9b9c3071 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updated VIF entry in instance network info cache for port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-aab46476-0774-47d4-839f-b0a4cb1008ce req-4ca00e5d-13e3-49cb-bdb8-f73b9b9c3071 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-aab46476-0774-47d4-839f-b0a4cb1008ce req-4ca00e5d-13e3-49cb-bdb8-f73b9b9c3071 service nova] Releasing lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-20018354-f45a-4fd7-b9a5-41143ec09c0e tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.996s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:32 user nova-compute[74959]: INFO nova.compute.manager [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Terminating instance
Nov 28 23:08:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-1f3c4abc-d5ce-4372-bafa-0714d6277795 req-b3254567-9640-4bfa-9b6a-12a2330ebd43 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received event network-vif-unplugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1f3c4abc-d5ce-4372-bafa-0714d6277795 req-b3254567-9640-4bfa-9b6a-12a2330ebd43 service nova] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1f3c4abc-d5ce-4372-bafa-0714d6277795 req-b3254567-9640-4bfa-9b6a-12a2330ebd43 service nova] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1f3c4abc-d5ce-4372-bafa-0714d6277795 req-b3254567-9640-4bfa-9b6a-12a2330ebd43 service nova] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-1f3c4abc-d5ce-4372-bafa-0714d6277795 req-b3254567-9640-4bfa-9b6a-12a2330ebd43 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] No waiting events found dispatching network-vif-unplugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-1f3c4abc-d5ce-4372-bafa-0714d6277795 req-b3254567-9640-4bfa-9b6a-12a2330ebd43 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received event network-vif-unplugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:08:33 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Instance destroyed successfully.
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.objects.instance [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'resources' on Instance uuid 7d4ca972-77ec-4a5c-8259-b695fba4b862 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1706804855',display_name='tempest-AttachVolumeNegativeTest-server-1706804855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1706804855',id=22,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD87G8a6eHCP+qf1Q47htpxgu9sXeGIPNUCvZpiNB0qgUXmYH8xuOmYM5FOQqEMU91mjSaHW1BHRubxiHt+o6Whx10EmF17gI3h2IhfD0yXAZwVgeReLcKUIZGDy69qMSQ==',key_name='tempest-keypair-318752727',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:05:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-94p8lhkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=7d4ca972-77ec-4a5c-8259-b695fba4b862,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "address": "fa:16:3e:d7:15:36", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7ad87d-15", "ovs_interfaceid": "aa7ad87d-15ef-4ede-8291-2a244cded2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:15:36,bridge_name='br-int',has_traffic_filtering=True,id=aa7ad87d-15ef-4ede-8291-2a244cded2b5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7ad87d-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG os_vif [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:15:36,bridge_name='br-int',has_traffic_filtering=True,id=aa7ad87d-15ef-4ede-8291-2a244cded2b5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7ad87d-15') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa7ad87d-15, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9d60042-011d-4d1d-8d12-7ae424a809b6) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:33 user nova-compute[74959]: INFO os_vif [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:15:36,bridge_name='br-int',has_traffic_filtering=True,id=aa7ad87d-15ef-4ede-8291-2a244cded2b5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7ad87d-15')
Nov 28 23:08:33 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Deleting instance files /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862_del
Nov 28 23:08:33 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Deletion of /opt/stack/data/nova/instances/7d4ca972-77ec-4a5c-8259-b695fba4b862_del complete
Nov 28 23:08:33 user nova-compute[74959]: INFO nova.compute.manager [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 23:08:33 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:08:33 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:08:34 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:34 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Took 0.78 seconds to deallocate network for instance.
Nov 28 23:08:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:08:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:08:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:35 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Deleted allocations for instance 7d4ca972-77ec-4a5c-8259-b695fba4b862
Nov 28 23:08:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-561227ec-f3e6-4a69-903b-1003844107aa tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.240s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-d8816d1e-28f1-4724-9aba-ae339153acf3 req-f5a88919-b98f-4c22-86ac-9c2bedc5ca24 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received event network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8816d1e-28f1-4724-9aba-ae339153acf3 req-f5a88919-b98f-4c22-86ac-9c2bedc5ca24 service nova] Acquiring lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8816d1e-28f1-4724-9aba-ae339153acf3 req-f5a88919-b98f-4c22-86ac-9c2bedc5ca24 service nova] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8816d1e-28f1-4724-9aba-ae339153acf3 req-f5a88919-b98f-4c22-86ac-9c2bedc5ca24 service nova] Lock "7d4ca972-77ec-4a5c-8259-b695fba4b862-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-d8816d1e-28f1-4724-9aba-ae339153acf3 req-f5a88919-b98f-4c22-86ac-9c2bedc5ca24 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] No waiting events found dispatching network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:35 user nova-compute[74959]: WARNING nova.compute.manager [req-d8816d1e-28f1-4724-9aba-ae339153acf3 req-f5a88919-b98f-4c22-86ac-9c2bedc5ca24 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received unexpected event network-vif-plugged-aa7ad87d-15ef-4ede-8291-2a244cded2b5 for instance with vm_state deleted and task_state None.
Nov 28 23:08:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-d8816d1e-28f1-4724-9aba-ae339153acf3 req-f5a88919-b98f-4c22-86ac-9c2bedc5ca24 service nova] [instance: 7d4ca972-77ec-4a5c-8259-b695fba4b862] Received event network-vif-deleted-aa7ad87d-15ef-4ede-8291-2a244cded2b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: e245a015-fc98-4557-8168-5089c3746e79] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:08:37 user nova-compute[74959]: INFO nova.compute.manager [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Detaching volume d85b92c4-b7f2-4b87-82e6-1d66f5b27212
Nov 28 23:08:37 user nova-compute[74959]: INFO nova.virt.block_device [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Attempting to driver detach volume d85b92c4-b7f2-4b87-82e6-1d66f5b27212 from mountpoint /dev/vdb
Nov 28 23:08:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Attempting to detach device vdb from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:08:37 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:08:37 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:08:37 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:08:37 user nova-compute[74959]:   <serial>d85b92c4-b7f2-4b87-82e6-1d66f5b27212</serial>
Nov 28 23:08:37 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:08:37 user nova-compute[74959]: </disk>
Nov 28 23:08:37 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:08:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Successfully detached device vdb from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c from the persistent domain config.
Nov 28 23:08:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:08:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:08:37 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:08:37 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:08:37 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:08:37 user nova-compute[74959]:   <serial>d85b92c4-b7f2-4b87-82e6-1d66f5b27212</serial>
Nov 28 23:08:37 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:08:37 user nova-compute[74959]: </disk>
Nov 28 23:08:37 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:08:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating instance_info_cache with network_info: [{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:08:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:08:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:46 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:08:46 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7568MB free_disk=25.25275421142578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 0bf7ba2c-355f-4ee4-8937-ad80724df48f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:08:46 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:08:47 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:08:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:08:48 user nova-compute[74959]: INFO nova.compute.claims [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Claim successful on node user
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:08:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.policy [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74e434d4b70f4c95be8af313a665e7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8c0790fe9a4457aec8ddcc8630f2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:08:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Creating image(s)
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk 1073741824" returned: 0 in 0.053s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Successfully created port: c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.250s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Cannot resize image /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Ensure instance console log exists: /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Successfully updated port: c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquired lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-0faa17be-5429-48b6-a1c9-f690e2098780 req-2fc98adb-5c9c-4857-a93d-cf5cfbe40828 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-changed-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-0faa17be-5429-48b6-a1c9-f690e2098780 req-2fc98adb-5c9c-4857-a93d-cf5cfbe40828 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Refreshing instance network info cache due to event network-changed-c897ce7f-6b41-4c61-9e90-56577c38cac7. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0faa17be-5429-48b6-a1c9-f690e2098780 req-2fc98adb-5c9c-4857-a93d-cf5cfbe40828 service nova] Acquiring lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:50 user nova-compute[74959]: INFO nova.compute.manager [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Terminating instance
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating instance_info_cache with network_info: [{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Releasing lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance network_info: |[{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0faa17be-5429-48b6-a1c9-f690e2098780 req-2fc98adb-5c9c-4857-a93d-cf5cfbe40828 service nova] Acquired lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.network.neutron [req-0faa17be-5429-48b6-a1c9-f690e2098780 req-2fc98adb-5c9c-4857-a93d-cf5cfbe40828 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Refreshing network info cache for port c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Start _get_guest_xml network_info=[{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:08:50 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:08:50 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-797958720',display_name='tempest-ServerStableDeviceRescueTest-server-797958720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-797958720',id=27,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwpnuwk3F4oQOUbvbeGHOHg77Y/1jNiciJERi9Nm37f3eKJeduzJ0yri0a7jRnXZu7o/hUCC83uhYv5J9OiUjya4c2oW4ivMUnAHM0Wmu33P6ssYkmPZv/AMPgZRp/Rpw==',key_name='tempest-keypair-138360968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c8c0790fe9a4457aec8ddcc8630f2ec',ramdisk_id='',reservation_id='r-almgevc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-366574212',owner_user_name='tempest-ServerStableDeviceRescueTest-366574212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74e434d4b70f4c95be8af313a665e7af',uuid=63d3691b-4d3d-44ca-ab1a-d778d1ac7304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Converting VIF {"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:a3:92,bridge_name='br-int',has_traffic_filtering=True,id=c897ce7f-6b41-4c61-9e90-56577c38cac7,network=Network(0e2291ed-66eb-4e96-9c11-f39100518417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc897ce7f-6b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.objects.instance [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'pci_devices' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:08:50 user nova-compute[74959]:   <uuid>63d3691b-4d3d-44ca-ab1a-d778d1ac7304</uuid>
Nov 28 23:08:50 user nova-compute[74959]:   <name>instance-0000001b</name>
Nov 28 23:08:50 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:08:50 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:08:50 user nova-compute[74959]:   <metadata>
Nov 28 23:08:50 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:08:50 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:08:50 user nova-compute[74959]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-797958720</nova:name>
Nov 28 23:08:50 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:08:50</nova:creationTime>
Nov 28 23:08:50 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:08:50 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:08:50 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:08:50 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:08:50 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:08:50 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:08:50 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:08:50 user nova-compute[74959]:       <nova:owner>
Nov 28 23:08:50 user nova-compute[74959]:         <nova:user uuid="74e434d4b70f4c95be8af313a665e7af">tempest-ServerStableDeviceRescueTest-366574212-project-member</nova:user>
Nov 28 23:08:50 user nova-compute[74959]:         <nova:project uuid="3c8c0790fe9a4457aec8ddcc8630f2ec">tempest-ServerStableDeviceRescueTest-366574212</nova:project>
Nov 28 23:08:50 user nova-compute[74959]:       </nova:owner>
Nov 28 23:08:50 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:08:50 user nova-compute[74959]:       <nova:ports>
Nov 28 23:08:50 user nova-compute[74959]:         <nova:port uuid="c897ce7f-6b41-4c61-9e90-56577c38cac7">
Nov 28 23:08:50 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 23:08:50 user nova-compute[74959]:         </nova:port>
Nov 28 23:08:50 user nova-compute[74959]:       </nova:ports>
Nov 28 23:08:50 user nova-compute[74959]:     </nova:instance>
Nov 28 23:08:50 user nova-compute[74959]:   </metadata>
Nov 28 23:08:50 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:08:50 user nova-compute[74959]:     <system>
Nov 28 23:08:50 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:08:50 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:08:50 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:08:50 user nova-compute[74959]:       <entry name="serial">63d3691b-4d3d-44ca-ab1a-d778d1ac7304</entry>
Nov 28 23:08:50 user nova-compute[74959]:       <entry name="uuid">63d3691b-4d3d-44ca-ab1a-d778d1ac7304</entry>
Nov 28 23:08:50 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:08:50 user nova-compute[74959]:     </system>
Nov 28 23:08:50 user nova-compute[74959]:   </sysinfo>
Nov 28 23:08:50 user nova-compute[74959]:   <os>
Nov 28 23:08:50 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:08:50 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:08:50 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:08:50 user nova-compute[74959]:   </os>
Nov 28 23:08:50 user nova-compute[74959]:   <features>
Nov 28 23:08:50 user nova-compute[74959]:     <acpi/>
Nov 28 23:08:50 user nova-compute[74959]:     <apic/>
Nov 28 23:08:50 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:08:50 user nova-compute[74959]:   </features>
Nov 28 23:08:50 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:08:50 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:08:50 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:08:50 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:08:50 user nova-compute[74959]:   </clock>
Nov 28 23:08:50 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:08:50 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:08:50 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:08:50 user nova-compute[74959]:   </cpu>
Nov 28 23:08:50 user nova-compute[74959]:   <devices>
Nov 28 23:08:50 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:08:50 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:08:50 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk"/>
Nov 28 23:08:50 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:08:50 user nova-compute[74959]:     </disk>
Nov 28 23:08:50 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:08:50 user nova-compute[74959]:       <mac address="fa:16:3e:59:a3:92"/>
Nov 28 23:08:50 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:08:50 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:08:50 user nova-compute[74959]:       <target dev="tapc897ce7f-6b"/>
Nov 28 23:08:50 user nova-compute[74959]:     </interface>
Nov 28 23:08:50 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:08:50 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/console.log" append="off"/>
Nov 28 23:08:50 user nova-compute[74959]:     </serial>
Nov 28 23:08:50 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:08:50 user nova-compute[74959]:     <video>
Nov 28 23:08:50 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:08:50 user nova-compute[74959]:     </video>
Nov 28 23:08:50 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:08:50 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:08:50 user nova-compute[74959]:     </rng>
Nov 28 23:08:50 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:08:50 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:08:50 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:08:50 user nova-compute[74959]:     </memballoon>
Nov 28 23:08:50 user nova-compute[74959]:   </devices>
Nov 28 23:08:50 user nova-compute[74959]: </domain>
Nov 28 23:08:50 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-797958720',display_name='tempest-ServerStableDeviceRescueTest-server-797958720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-797958720',id=27,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwpnuwk3F4oQOUbvbeGHOHg77Y/1jNiciJERi9Nm37f3eKJeduzJ0yri0a7jRnXZu7o/hUCC83uhYv5J9OiUjya4c2oW4ivMUnAHM0Wmu33P6ssYkmPZv/AMPgZRp/Rpw==',key_name='tempest-keypair-138360968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c8c0790fe9a4457aec8ddcc8630f2ec',ramdisk_id='',reservation_id='r-almgevc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-366574212',owner_user_name='tempest-ServerStableDeviceRescueTest-366574212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74e434d4b70f4c95be8af313a665e7af',uuid=63d3691b-4d3d-44ca-ab1a-d778d1ac7304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Converting VIF {"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:a3:92,bridge_name='br-int',has_traffic_filtering=True,id=c897ce7f-6b41-4c61-9e90-56577c38cac7,network=Network(0e2291ed-66eb-4e96-9c11-f39100518417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc897ce7f-6b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG os_vif [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:a3:92,bridge_name='br-int',has_traffic_filtering=True,id=c897ce7f-6b41-4c61-9e90-56577c38cac7,network=Network(0e2291ed-66eb-4e96-9c11-f39100518417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc897ce7f-6b') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a04cf6cb-0d18-5a46-863a-c17abc1d06b8', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc897ce7f-6b, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc897ce7f-6b, col_values=(('qos', UUID('7971328e-7f29-4e67-93bf-2fc1642bc0eb')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc897ce7f-6b, col_values=(('external_ids', {'iface-id': 'c897ce7f-6b41-4c61-9e90-56577c38cac7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:a3:92', 'vm-uuid': '63d3691b-4d3d-44ca-ab1a-d778d1ac7304'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-73d86c4a-f8e1-4cc1-af5e-aa47ca39bda9 req-abb8c5c6-491a-4ac4-83ed-fcf7baaa43bd service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-73d86c4a-f8e1-4cc1-af5e-aa47ca39bda9 req-abb8c5c6-491a-4ac4-83ed-fcf7baaa43bd service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-73d86c4a-f8e1-4cc1-af5e-aa47ca39bda9 req-abb8c5c6-491a-4ac4-83ed-fcf7baaa43bd service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-73d86c4a-f8e1-4cc1-af5e-aa47ca39bda9 req-abb8c5c6-491a-4ac4-83ed-fcf7baaa43bd service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-73d86c4a-f8e1-4cc1-af5e-aa47ca39bda9 req-abb8c5c6-491a-4ac4-83ed-fcf7baaa43bd service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-73d86c4a-f8e1-4cc1-af5e-aa47ca39bda9 req-abb8c5c6-491a-4ac4-83ed-fcf7baaa43bd service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: INFO os_vif [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:a3:92,bridge_name='br-int',has_traffic_filtering=True,id=c897ce7f-6b41-4c61-9e90-56577c38cac7,network=Network(0e2291ed-66eb-4e96-9c11-f39100518417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc897ce7f-6b')
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No VIF found with MAC fa:16:3e:59:a3:92, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.network.neutron [req-0faa17be-5429-48b6-a1c9-f690e2098780 req-2fc98adb-5c9c-4857-a93d-cf5cfbe40828 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updated VIF entry in instance network info cache for port c897ce7f-6b41-4c61-9e90-56577c38cac7. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.network.neutron [req-0faa17be-5429-48b6-a1c9-f690e2098780 req-2fc98adb-5c9c-4857-a93d-cf5cfbe40828 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating instance_info_cache with network_info: [{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0faa17be-5429-48b6-a1c9-f690e2098780 req-2fc98adb-5c9c-4857-a93d-cf5cfbe40828 service nova] Releasing lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Instance destroyed successfully.
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'resources' on Instance uuid 9492b249-758e-4b8f-acfb-f334ef80a9dd {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1150032391',display_name='tempest-AttachVolumeTestJSON-server-1150032391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1150032391',id=6,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXsBopYqm32V0aFak+fqNyovgCNYgdWwD7G4CelRY87ofywteNGq0sLYhEPxvogEfALVGN2Q7UqfkclUOzeLITco/xbmOBZV5V5XOkuoJeWDlcS9BfaQEW/FMNQLNOSIA==',key_name='tempest-keypair-1953125520',keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-6mdnky6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:07:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=9492b249-758e-4b8f-acfb-f334ef80a9dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "address": "fa:16:3e:69:f4:ad", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8a2c4-07", "ovs_interfaceid": "ded8a2c4-07d6-440e-9110-4c2a7b2738f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG os_vif [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapded8a2c4-07, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7da20d87-64bc-4583-9368-b384247523d5) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:08:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:51 user nova-compute[74959]: INFO os_vif [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f4:ad,bridge_name='br-int',has_traffic_filtering=True,id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8a2c4-07')
Nov 28 23:08:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Deleting instance files /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd_del
Nov 28 23:08:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Deletion of /opt/stack/data/nova/instances/9492b249-758e-4b8f-acfb-f334ef80a9dd_del complete
Nov 28 23:08:52 user nova-compute[74959]: INFO nova.compute.manager [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 28 23:08:52 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:52 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Took 0.87 seconds to deallocate network for instance.
Nov 28 23:08:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-70742b5f-2b46-4c2d-9bd4-476a195a304a req-a092b4bd-0004-496f-8db9-98c0fc01810a service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-deleted-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:52 user nova-compute[74959]: INFO nova.compute.manager [req-70742b5f-2b46-4c2d-9bd4-476a195a304a req-a092b4bd-0004-496f-8db9-98c0fc01810a service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Neutron deleted interface ded8a2c4-07d6-440e-9110-4c2a7b2738f2; detaching it from the instance and deleting it from the info cache
Nov 28 23:08:52 user nova-compute[74959]: DEBUG nova.network.neutron [req-70742b5f-2b46-4c2d-9bd4-476a195a304a req-a092b4bd-0004-496f-8db9-98c0fc01810a service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-70742b5f-2b46-4c2d-9bd4-476a195a304a req-a092b4bd-0004-496f-8db9-98c0fc01810a service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Detach interface failed, port_id=ded8a2c4-07d6-440e-9110-4c2a7b2738f2, reason: Instance 9492b249-758e-4b8f-acfb-f334ef80a9dd could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:53 user nova-compute[74959]: WARNING nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state deleted and task_state None.
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:53 user nova-compute[74959]: WARNING nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state deleted and task_state None.
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:53 user nova-compute[74959]: WARNING nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state deleted and task_state None.
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:53 user nova-compute[74959]: WARNING nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-unplugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state deleted and task_state None.
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Acquiring lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] No waiting events found dispatching network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:53 user nova-compute[74959]: WARNING nova.compute.manager [req-3fa92e8d-3c86-4e6d-9023-eccc53e3f5dc req-7f9d0f99-3db9-454d-820d-971d451064a7 service nova] [instance: 9492b249-758e-4b8f-acfb-f334ef80a9dd] Received unexpected event network-vif-plugged-ded8a2c4-07d6-440e-9110-4c2a7b2738f2 for instance with vm_state deleted and task_state None.
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:53 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Deleted allocations for instance 9492b249-758e-4b8f-acfb-f334ef80a9dd
Nov 28 23:08:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ea603565-c0ce-4b57-9089-6af33ea95521 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "9492b249-758e-4b8f-acfb-f334ef80a9dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.822s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:08:55 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance spawned successfully.
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:55 user nova-compute[74959]: WARNING nova.compute.manager [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state building and task_state spawning.
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:55 user nova-compute[74959]: WARNING nova.compute.manager [req-0e2f6c5d-7f2c-4d78-b0a1-f41bd7737cf4 req-2375e3e9-1b21-49dc-b594-3256c28a5b4d service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state building and task_state spawning.
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:08:55 user nova-compute[74959]: INFO nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 28 23:08:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:08:55 user nova-compute[74959]: INFO nova.compute.manager [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Took 7.17 seconds to build instance.
Nov 28 23:08:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a90455ce-1d84-47c7-a70b-3c381f47f2cb tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.265s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:56 user nova-compute[74959]: INFO nova.compute.manager [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Rescuing
Nov 28 23:08:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquired lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:08:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updating instance_info_cache with network_info: [{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Releasing lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-1a40f689-3d6e-4b26-9a33-81b4dc0f8bac req-fcd5cb35-c9cc-4909-a599-85701eccb0ca service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1a40f689-3d6e-4b26-9a33-81b4dc0f8bac req-fcd5cb35-c9cc-4909-a599-85701eccb0ca service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1a40f689-3d6e-4b26-9a33-81b4dc0f8bac req-fcd5cb35-c9cc-4909-a599-85701eccb0ca service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1a40f689-3d6e-4b26-9a33-81b4dc0f8bac req-fcd5cb35-c9cc-4909-a599-85701eccb0ca service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-1a40f689-3d6e-4b26-9a33-81b4dc0f8bac req-fcd5cb35-c9cc-4909-a599-85701eccb0ca service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:57 user nova-compute[74959]: WARNING nova.compute.manager [req-1a40f689-3d6e-4b26-9a33-81b4dc0f8bac req-fcd5cb35-c9cc-4909-a599-85701eccb0ca service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state active and task_state rescuing.
Nov 28 23:08:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance destroyed successfully.
Nov 28 23:08:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Attempting rescue
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74959) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance directory exists: not creating {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 23:08:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Creating image(s)
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.011s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c is timed out.
Nov 28 23:08:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Successfully detached device vdb from instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c from the live domain config.
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBzDKePU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:08:58 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefd422f-3474-4fc6-a008-5a52fd8c143b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:08:58 user nova-compute[74959]: No targets found.
Nov 28 23:08:58 user nova-compute[74959]: iSNS:
Nov 28 23:08:58 user nova-compute[74959]: No targets found.
Nov 28 23:08:58 user nova-compute[74959]: STATIC:
Nov 28 23:08:58 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212
Nov 28 23:08:58 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:58 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:58 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:08:58 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:58 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:58 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:08:58 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:08:58 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:08:58 user nova-compute[74959]: FIRMWARE:
Nov 28 23:08:58 user nova-compute[74959]: No targets found.
Nov 28 23:08:58 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:08:58 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:08:58 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dde744-db9b-4085-951b-30160653f775]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cd920c-a5d7-4a44-aa2a-3a95f796e8ab]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:08:58 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:08:58 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:08:58 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:08:58 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:08:58 user nova-compute[74959]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 (non-flash)
Nov 28 23:08:58 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef47a6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212'): ({'sdf'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Removing single pathed devices sdf {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf874e-5a67-42c3-9ce7-7efaa02166ee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5bbc93-9528-445d-ae9a-2fd53ca22b97]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Flushing IO for device /dev/sdf {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.227s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4722bd7c-7c26-4354-b86f-740405d6cfef]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue" returned: 0 in 0.055s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'migration_context' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee53bd0d-44b2-49ff-be90-1e0a8171b11e]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.base [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<5d351a14-fe3f-4c98-833c-cdff15e5831b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Start _get_guest_xml network_info=[{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:a7:5f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'resources' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.base [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<5d351a14-fe3f-4c98-833c-cdff15e5831b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'numa_topology' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4543ebb-ad5e-4659-ab71-951d72f1dc0e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.base [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<5d351a14-fe3f-4c98-833c-cdff15e5831b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:08:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:08:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.base [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<5d351a14-fe3f-4c98-833c-cdff15e5831b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1764014992',display_name='tempest-ServerRescueNegativeTestJSON-server-1764014992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1764014992',id=18,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-oh9l1yxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:04:21Z,user_data=None,user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=5d351a14-fe3f-4c98-833c-cdff15e5831b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:a7:5f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:a7:5f:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:5f:d1,bridge_name='br-int',has_traffic_filtering=True,id=0ea3d331-73b7-4329-8f0a-83513c3c6b24,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3d331-73') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf248f9f-5d5e-42f4-9518-df89ead683b6]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212, portal: 172.16.0.220,3260]
Nov 28 23:08:58 user nova-compute[74959]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212, portal: 172.16.0.220,3260] successful.
Nov 28 23:08:58 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.objects.base [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<5d351a14-fe3f-4c98-833c-cdff15e5831b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:08:58 user nova-compute[74959]:   <uuid>5d351a14-fe3f-4c98-833c-cdff15e5831b</uuid>
Nov 28 23:08:58 user nova-compute[74959]:   <name>instance-00000012</name>
Nov 28 23:08:58 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:08:58 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:08:58 user nova-compute[74959]:   <metadata>
Nov 28 23:08:58 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:08:58 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:08:58 user nova-compute[74959]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1764014992</nova:name>
Nov 28 23:08:58 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:08:58</nova:creationTime>
Nov 28 23:08:58 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:08:58 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:08:58 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:08:58 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:08:58 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:08:58 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:08:58 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:08:58 user nova-compute[74959]:       <nova:owner>
Nov 28 23:08:58 user nova-compute[74959]:         <nova:user uuid="a59fecc5b484491ca4f6b326d8bfcb67">tempest-ServerRescueNegativeTestJSON-1452838145-project-member</nova:user>
Nov 28 23:08:58 user nova-compute[74959]:         <nova:project uuid="d69f1c42c1314a41ac6a4ae41fb64c7c">tempest-ServerRescueNegativeTestJSON-1452838145</nova:project>
Nov 28 23:08:58 user nova-compute[74959]:       </nova:owner>
Nov 28 23:08:58 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:08:58 user nova-compute[74959]:       <nova:ports>
Nov 28 23:08:58 user nova-compute[74959]:         <nova:port uuid="0ea3d331-73b7-4329-8f0a-83513c3c6b24">
Nov 28 23:08:58 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 23:08:58 user nova-compute[74959]:         </nova:port>
Nov 28 23:08:58 user nova-compute[74959]:       </nova:ports>
Nov 28 23:08:58 user nova-compute[74959]:     </nova:instance>
Nov 28 23:08:58 user nova-compute[74959]:   </metadata>
Nov 28 23:08:58 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:08:58 user nova-compute[74959]:     <system>
Nov 28 23:08:58 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:08:58 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:08:58 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:08:58 user nova-compute[74959]:       <entry name="serial">5d351a14-fe3f-4c98-833c-cdff15e5831b</entry>
Nov 28 23:08:58 user nova-compute[74959]:       <entry name="uuid">5d351a14-fe3f-4c98-833c-cdff15e5831b</entry>
Nov 28 23:08:58 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:08:58 user nova-compute[74959]:     </system>
Nov 28 23:08:58 user nova-compute[74959]:   </sysinfo>
Nov 28 23:08:58 user nova-compute[74959]:   <os>
Nov 28 23:08:58 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:08:58 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:08:58 user nova-compute[74959]:   </os>
Nov 28 23:08:58 user nova-compute[74959]:   <features>
Nov 28 23:08:58 user nova-compute[74959]:     <acpi/>
Nov 28 23:08:58 user nova-compute[74959]:     <apic/>
Nov 28 23:08:58 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:08:58 user nova-compute[74959]:   </features>
Nov 28 23:08:58 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:08:58 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:08:58 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:08:58 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:08:58 user nova-compute[74959]:   </clock>
Nov 28 23:08:58 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:08:58 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:08:58 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:08:58 user nova-compute[74959]:   </cpu>
Nov 28 23:08:58 user nova-compute[74959]:   <devices>
Nov 28 23:08:58 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:08:58 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:08:58 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue"/>
Nov 28 23:08:58 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:08:58 user nova-compute[74959]:     </disk>
Nov 28 23:08:58 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:08:58 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:08:58 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk"/>
Nov 28 23:08:58 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:08:58 user nova-compute[74959]:     </disk>
Nov 28 23:08:58 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:08:58 user nova-compute[74959]:       <mac address="fa:16:3e:a7:5f:d1"/>
Nov 28 23:08:58 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:08:58 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:08:58 user nova-compute[74959]:       <target dev="tap0ea3d331-73"/>
Nov 28 23:08:58 user nova-compute[74959]:     </interface>
Nov 28 23:08:58 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:08:58 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/console.log" append="off"/>
Nov 28 23:08:58 user nova-compute[74959]:     </serial>
Nov 28 23:08:58 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:08:58 user nova-compute[74959]:     <video>
Nov 28 23:08:58 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:08:58 user nova-compute[74959]:     </video>
Nov 28 23:08:58 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:08:58 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:08:58 user nova-compute[74959]:     </rng>
Nov 28 23:08:58 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:08:58 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:08:58 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:08:58 user nova-compute[74959]:     </memballoon>
Nov 28 23:08:58 user nova-compute[74959]:   </devices>
Nov 28 23:08:58 user nova-compute[74959]: </domain>
Nov 28 23:08:58 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:08:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance destroyed successfully.
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d85b92c4-b7f2-4b87-82e6-1d66f5b27212 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0507512-7837-4b22-a722-2d7bff2a68c4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] <== disconnect_volume: return (436ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:08:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No VIF found with MAC fa:16:3e:a7:5f:d1, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:59 user nova-compute[74959]: INFO nova.compute.manager [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Shelve offloading
Nov 28 23:08:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-48c8f82f-9cf6-405e-aa2a-80a527c976ff req-9ea1884a-d475-419f-b185-426b69526cb7 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-unplugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-48c8f82f-9cf6-405e-aa2a-80a527c976ff req-9ea1884a-d475-419f-b185-426b69526cb7 service nova] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-48c8f82f-9cf6-405e-aa2a-80a527c976ff req-9ea1884a-d475-419f-b185-426b69526cb7 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-48c8f82f-9cf6-405e-aa2a-80a527c976ff req-9ea1884a-d475-419f-b185-426b69526cb7 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-48c8f82f-9cf6-405e-aa2a-80a527c976ff req-9ea1884a-d475-419f-b185-426b69526cb7 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] No waiting events found dispatching network-vif-unplugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:59 user nova-compute[74959]: WARNING nova.compute.manager [req-48c8f82f-9cf6-405e-aa2a-80a527c976ff req-9ea1884a-d475-419f-b185-426b69526cb7 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received unexpected event network-vif-unplugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f for instance with vm_state active and task_state shelving.
Nov 28 23:08:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:08:59 user nova-compute[74959]: WARNING nova.compute.manager [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state active and task_state rescuing.
Nov 28 23:08:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing instance network info cache due to event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] Acquiring lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] Acquired lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:08:59 user nova-compute[74959]: DEBUG nova.network.neutron [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:09:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance destroyed successfully.
Nov 28 23:09:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lazy-loading 'flavor' on Instance uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-85d6f23a-8e7f-467d-9a91-a5de8044cdc5 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.279s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG nova.network.neutron [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updated VIF entry in instance network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG nova.network.neutron [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d04d27ea-dc91-46c1-9ecc-8e87eaf87045 req-4c3ff9ea-07d4-4304-a943-cdca78bf05ae service nova] Releasing lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquired lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG nova.network.neutron [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:09:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-3ccf823c-8920-47bd-b2b3-c58d495e7d66 req-0f9787f1-8556-4588-aeae-e3af8ec9f16d service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3ccf823c-8920-47bd-b2b3-c58d495e7d66 req-0f9787f1-8556-4588-aeae-e3af8ec9f16d service nova] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3ccf823c-8920-47bd-b2b3-c58d495e7d66 req-0f9787f1-8556-4588-aeae-e3af8ec9f16d service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3ccf823c-8920-47bd-b2b3-c58d495e7d66 req-0f9787f1-8556-4588-aeae-e3af8ec9f16d service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-3ccf823c-8920-47bd-b2b3-c58d495e7d66 req-0f9787f1-8556-4588-aeae-e3af8ec9f16d service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] No waiting events found dispatching network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:01 user nova-compute[74959]: WARNING nova.compute.manager [req-3ccf823c-8920-47bd-b2b3-c58d495e7d66 req-0f9787f1-8556-4588-aeae-e3af8ec9f16d service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received unexpected event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f for instance with vm_state active and task_state shelving.
Nov 28 23:09:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Releasing lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:01 user nova-compute[74959]: WARNING nova.compute.manager [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state active and task_state rescuing.
Nov 28 23:09:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:01 user nova-compute[74959]: WARNING nova.compute.manager [req-72ce4153-d93f-4182-9006-c8ef5b6fd136 req-33408fd0-0c01-4150-911a-37df601974d1 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state active and task_state rescuing.
Nov 28 23:09:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:02 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance destroyed successfully.
Nov 28 23:09:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lazy-loading 'resources' on Instance uuid 0bf7ba2c-355f-4ee4-8937-ad80724df48f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1099925087',display_name='tempest-TestShelveInstance-server-1099925087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1099925087',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUpUnh16KnhRFBjgrExrRBzAPZOMbfROnxIB/QzkB4XOJ4EkaMvtcMIzGiCMrfg7Ikqsa2yKPERXntT/PzeG19u5v85fNuNBonobsX6Lu/DYlmy81bO6leef1roSi+Sug==',key_name='tempest-TestShelveInstance-1413730831',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e326f1cb3b64f78b1cd0ef5adc09323',ramdisk_id='',reservation_id='r-owauny1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-19474985',owner_user_name='tempest-TestShelveInstance-19474985-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:07:20Z,user_data=None,user_id='305832e59f9846b2923717725a362cbc',uuid=0bf7ba2c-355f-4ee4-8937-ad80724df48f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converting VIF {"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_vif [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4e208b-60, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=787791ad-6093-4b44-a929-444277b489b7) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:02 user nova-compute[74959]: INFO os_vif [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60')
Nov 28 23:09:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePFtYNkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:09:02 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8db726d-0e25-4c2d-9963-4791d06204e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:09:02 user nova-compute[74959]: No targets found.
Nov 28 23:09:02 user nova-compute[74959]: iSNS:
Nov 28 23:09:02 user nova-compute[74959]: No targets found.
Nov 28 23:09:02 user nova-compute[74959]: STATIC:
Nov 28 23:09:02 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:09:02 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:09:02 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:09:02 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:09:02 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:09:02 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:09:02 user nova-compute[74959]: FIRMWARE:
Nov 28 23:09:02 user nova-compute[74959]: No targets found.
Nov 28 23:09:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:09:02 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:09:02 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9215834d-c9a7-47d0-a8e4-7648c84d3334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a93edb-ef75-440f-b564-b7c3806afa37]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:09:02 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:09:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:09:02 user nova-compute[74959]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:09:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc58edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d'): ({'sde'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Removing single pathed devices sde {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d3ad3e-1bff-408d-84b6-ea34c9550057]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae43415-dfa7-4099-8eda-69f25405e0ac]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Flushing IO for device /dev/sde {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09813c4-4500-464f-9cf2-3f7f7539502c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb63836-e718-4bf3-bb3d-fe33303edea3]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a110e4-c91c-426a-b0d4-709c911da558]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[db942bee-4fff-4c54-a792-68c83d5c5a1a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260]
Nov 28 23:09:02 user nova-compute[74959]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260] successful.
Nov 28 23:09:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21bcdd6-025a-43c8-a099-56e4a4e46461]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] <== disconnect_volume: return (312ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:09:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:09:02 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Deleting instance files /opt/stack/data/nova/instances/0bf7ba2c-355f-4ee4-8937-ad80724df48f_del
Nov 28 23:09:02 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Deletion of /opt/stack/data/nova/instances/0bf7ba2c-355f-4ee4-8937-ad80724df48f_del complete
Nov 28 23:09:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2ba3ed5c-ffea-4c54-95c7-00602ce7d02e tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:09:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-21d2b279-f298-4732-8033-25bdf84759c2 req-b2011d8e-08c9-476c-bd5b-3334c29382cb service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-21d2b279-f298-4732-8033-25bdf84759c2 req-b2011d8e-08c9-476c-bd5b-3334c29382cb service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing instance network info cache due to event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:09:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21d2b279-f298-4732-8033-25bdf84759c2 req-b2011d8e-08c9-476c-bd5b-3334c29382cb service nova] Acquiring lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21d2b279-f298-4732-8033-25bdf84759c2 req-b2011d8e-08c9-476c-bd5b-3334c29382cb service nova] Acquired lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-21d2b279-f298-4732-8033-25bdf84759c2 req-b2011d8e-08c9-476c-bd5b-3334c29382cb service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:09:04 user nova-compute[74959]: DEBUG nova.network.neutron [req-21d2b279-f298-4732-8033-25bdf84759c2 req-b2011d8e-08c9-476c-bd5b-3334c29382cb service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updated VIF entry in instance network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:09:04 user nova-compute[74959]: DEBUG nova.network.neutron [req-21d2b279-f298-4732-8033-25bdf84759c2 req-b2011d8e-08c9-476c-bd5b-3334c29382cb service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": null, "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8b4e208b-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21d2b279-f298-4732-8033-25bdf84759c2 req-b2011d8e-08c9-476c-bd5b-3334c29382cb service nova] Releasing lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:06 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Deleted allocations for instance 0bf7ba2c-355f-4ee4-8937-ad80724df48f
Nov 28 23:09:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:06 user nova-compute[74959]: DEBUG nova.objects.instance [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lazy-loading 'numa_topology' on Instance uuid 0bf7ba2c-355f-4ee4-8937-ad80724df48f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:09:06 user nova-compute[74959]: DEBUG nova.objects.base [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Object Instance<0bf7ba2c-355f-4ee4-8937-ad80724df48f> lazy-loaded attributes: resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:09:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:06 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:09:06 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:09:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4b2347a1-6898-408c-9398-e2fa399e666a tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 7.564s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-e3fed054-3c4e-4d65-ae93-1d942ee93350 req-bda62abb-a1b6-40a7-9501-7c6526ffea6f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-changed-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-e3fed054-3c4e-4d65-ae93-1d942ee93350 req-bda62abb-a1b6-40a7-9501-7c6526ffea6f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Refreshing instance network info cache due to event network-changed-72a7bc36-1b60-4142-885f-33c78bb17209. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:09:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e3fed054-3c4e-4d65-ae93-1d942ee93350 req-bda62abb-a1b6-40a7-9501-7c6526ffea6f service nova] Acquiring lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e3fed054-3c4e-4d65-ae93-1d942ee93350 req-bda62abb-a1b6-40a7-9501-7c6526ffea6f service nova] Acquired lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-e3fed054-3c4e-4d65-ae93-1d942ee93350 req-bda62abb-a1b6-40a7-9501-7c6526ffea6f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Refreshing network info cache for port 72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:09:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-e3fed054-3c4e-4d65-ae93-1d942ee93350 req-bda62abb-a1b6-40a7-9501-7c6526ffea6f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updated VIF entry in instance network info cache for port 72a7bc36-1b60-4142-885f-33c78bb17209. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:09:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-e3fed054-3c4e-4d65-ae93-1d942ee93350 req-bda62abb-a1b6-40a7-9501-7c6526ffea6f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updating instance_info_cache with network_info: [{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e3fed054-3c4e-4d65-ae93-1d942ee93350 req-bda62abb-a1b6-40a7-9501-7c6526ffea6f service nova] Releasing lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:28 user nova-compute[74959]: INFO nova.compute.manager [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Terminating instance
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-795bec31-70f7-4010-948c-0bf3efd19887 req-16cb3654-48d3-4f92-890e-fa9f51a4fa2f service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received event network-vif-unplugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-795bec31-70f7-4010-948c-0bf3efd19887 req-16cb3654-48d3-4f92-890e-fa9f51a4fa2f service nova] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-795bec31-70f7-4010-948c-0bf3efd19887 req-16cb3654-48d3-4f92-890e-fa9f51a4fa2f service nova] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-795bec31-70f7-4010-948c-0bf3efd19887 req-16cb3654-48d3-4f92-890e-fa9f51a4fa2f service nova] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-795bec31-70f7-4010-948c-0bf3efd19887 req-16cb3654-48d3-4f92-890e-fa9f51a4fa2f service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] No waiting events found dispatching network-vif-unplugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-795bec31-70f7-4010-948c-0bf3efd19887 req-16cb3654-48d3-4f92-890e-fa9f51a4fa2f service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received event network-vif-unplugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Instance destroyed successfully.
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lazy-loading 'resources' on Instance uuid ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-169981963',display_name='tempest-TestServerVolumeAttachmentScenario-server-169981963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-169981963',id=21,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgK0eGXXI8cZ+BzSSVWQ9E23FrjuyLujL4qcokzSPF6gx97KGVcJBKOgYYfwftXNIgmAVpyyjNAjJguIxam8imLyDOnmqNXUR/pobQLhcmpDB2GKgc0wqggkh0tgqpIAQ==',key_name='tempest-keypair-1664512815',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:05:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93f3da93b47d4f969f058c6fd6867823',ramdisk_id='',reservation_id='r-cvu8yvri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1475661741',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1475661741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dd69e22dca14d07a72e497724aaebeb',uuid=ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Converting VIF {"id": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "address": "fa:16:3e:f3:22:ee", "network": {"id": "52c61db4-72b0-44ee-9979-db0dfe02bd15", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2026881992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93f3da93b47d4f969f058c6fd6867823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5cf4232-6f", "ovs_interfaceid": "b5cf4232-6f1a-4a52-bb84-151c4d04e12b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=b5cf4232-6f1a-4a52-bb84-151c4d04e12b,network=Network(52c61db4-72b0-44ee-9979-db0dfe02bd15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5cf4232-6f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG os_vif [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=b5cf4232-6f1a-4a52-bb84-151c4d04e12b,network=Network(52c61db4-72b0-44ee-9979-db0dfe02bd15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5cf4232-6f') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5cf4232-6f, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7620d96-3f54-4d9c-b24a-20570a8865b4) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:09:28 user nova-compute[74959]: INFO os_vif [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:22:ee,bridge_name='br-int',has_traffic_filtering=True,id=b5cf4232-6f1a-4a52-bb84-151c4d04e12b,network=Network(52c61db4-72b0-44ee-9979-db0dfe02bd15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5cf4232-6f')
Nov 28 23:09:28 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Deleting instance files /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c_del
Nov 28 23:09:28 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Deletion of /opt/stack/data/nova/instances/ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c_del complete
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:28 user nova-compute[74959]: INFO nova.compute.manager [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 23:09:28 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:09:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:09:29 user nova-compute[74959]: INFO nova.compute.claims [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Claim successful on node user
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.network.neutron [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:09:29 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.policy [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11f0d2814e7e4df6904596bc07befe0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c57e434911c407189c1801142c226e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:09:29 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Creating image(s)
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "/opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "/opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:30 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Took 1.12 seconds to deallocate network for instance.
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk 1073741824" returned: 0 in 0.056s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-65a47231-26df-4d3a-8780-64a10130c780 req-36fa7650-31db-4d7b-8a20-d1594e24d815 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received event network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-65a47231-26df-4d3a-8780-64a10130c780 req-36fa7650-31db-4d7b-8a20-d1594e24d815 service nova] Acquiring lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-65a47231-26df-4d3a-8780-64a10130c780 req-36fa7650-31db-4d7b-8a20-d1594e24d815 service nova] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-65a47231-26df-4d3a-8780-64a10130c780 req-36fa7650-31db-4d7b-8a20-d1594e24d815 service nova] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-65a47231-26df-4d3a-8780-64a10130c780 req-36fa7650-31db-4d7b-8a20-d1594e24d815 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] No waiting events found dispatching network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:30 user nova-compute[74959]: WARNING nova.compute.manager [req-65a47231-26df-4d3a-8780-64a10130c780 req-36fa7650-31db-4d7b-8a20-d1594e24d815 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received unexpected event network-vif-plugged-b5cf4232-6f1a-4a52-bb84-151c4d04e12b for instance with vm_state deleted and task_state None.
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-65a47231-26df-4d3a-8780-64a10130c780 req-36fa7650-31db-4d7b-8a20-d1594e24d815 service nova] [instance: ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c] Received event network-vif-deleted-b5cf4232-6f1a-4a52-bb84-151c4d04e12b {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.network.neutron [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Successfully created port: db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Cannot resize image /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Ensure instance console log exists: /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:30 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Deleted allocations for instance ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c
Nov 28 23:09:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5bdec429-9d6c-4260-acd3-97cb9fddccf4 tempest-TestServerVolumeAttachmentScenario-1475661741 tempest-TestServerVolumeAttachmentScenario-1475661741-project-member] Lock "ef6fc196-bed5-4d81-a4e7-4d59e1ba6c9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.725s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG nova.network.neutron [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Successfully updated port: db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquired lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG nova.network.neutron [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG nova.network.neutron [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-9357f798-95bb-4477-b0c8-7d4d39bd8817 req-7ef0c3e3-69b3-4427-9457-9a837bc2253d service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received event network-changed-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-9357f798-95bb-4477-b0c8-7d4d39bd8817 req-7ef0c3e3-69b3-4427-9457-9a837bc2253d service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Refreshing instance network info cache due to event network-changed-db47062d-08bc-466e-9e85-472b2c58f9c5. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:09:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9357f798-95bb-4477-b0c8-7d4d39bd8817 req-7ef0c3e3-69b3-4427-9457-9a837bc2253d service nova] Acquiring lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.network.neutron [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Updating instance_info_cache with network_info: [{"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Releasing lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Instance network_info: |[{"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9357f798-95bb-4477-b0c8-7d4d39bd8817 req-7ef0c3e3-69b3-4427-9457-9a837bc2253d service nova] Acquired lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.network.neutron [req-9357f798-95bb-4477-b0c8-7d4d39bd8817 req-7ef0c3e3-69b3-4427-9457-9a837bc2253d service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Refreshing network info cache for port db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Start _get_guest_xml network_info=[{"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:09:32 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:09:32 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1706459353',display_name='tempest-AttachVolumeNegativeTest-server-1706459353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1706459353',id=28,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAMmCF0LQCh7VRVGEbHICZFjofwCOvLd25CBPgLOxDrjGw6O/EUnBLbN2EOOAoJAyGRzBj9Of+7FA+DHf1OHzn4rec/lTg2DE+Uy0Lp0gHntT/2SH4FGpDOSJ16Kbp3GQ==',key_name='tempest-keypair-1358675322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-tygvo02a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=d0c359b5-f676-47a2-9e6e-e83e1813206b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=db47062d-08bc-466e-9e85-472b2c58f9c5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb47062d-08') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.objects.instance [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'pci_devices' on Instance uuid d0c359b5-f676-47a2-9e6e-e83e1813206b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:09:32 user nova-compute[74959]:   <uuid>d0c359b5-f676-47a2-9e6e-e83e1813206b</uuid>
Nov 28 23:09:32 user nova-compute[74959]:   <name>instance-0000001c</name>
Nov 28 23:09:32 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:09:32 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:09:32 user nova-compute[74959]:   <metadata>
Nov 28 23:09:32 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:09:32 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:09:32 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1706459353</nova:name>
Nov 28 23:09:32 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:09:32</nova:creationTime>
Nov 28 23:09:32 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:09:32 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:09:32 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:09:32 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:09:32 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:09:32 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:09:32 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:09:32 user nova-compute[74959]:       <nova:owner>
Nov 28 23:09:32 user nova-compute[74959]:         <nova:user uuid="11f0d2814e7e4df6904596bc07befe0e">tempest-AttachVolumeNegativeTest-1174707224-project-member</nova:user>
Nov 28 23:09:32 user nova-compute[74959]:         <nova:project uuid="1c57e434911c407189c1801142c226e1">tempest-AttachVolumeNegativeTest-1174707224</nova:project>
Nov 28 23:09:32 user nova-compute[74959]:       </nova:owner>
Nov 28 23:09:32 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:09:32 user nova-compute[74959]:       <nova:ports>
Nov 28 23:09:32 user nova-compute[74959]:         <nova:port uuid="db47062d-08bc-466e-9e85-472b2c58f9c5">
Nov 28 23:09:32 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 23:09:32 user nova-compute[74959]:         </nova:port>
Nov 28 23:09:32 user nova-compute[74959]:       </nova:ports>
Nov 28 23:09:32 user nova-compute[74959]:     </nova:instance>
Nov 28 23:09:32 user nova-compute[74959]:   </metadata>
Nov 28 23:09:32 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:09:32 user nova-compute[74959]:     <system>
Nov 28 23:09:32 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:09:32 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:09:32 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:09:32 user nova-compute[74959]:       <entry name="serial">d0c359b5-f676-47a2-9e6e-e83e1813206b</entry>
Nov 28 23:09:32 user nova-compute[74959]:       <entry name="uuid">d0c359b5-f676-47a2-9e6e-e83e1813206b</entry>
Nov 28 23:09:32 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:09:32 user nova-compute[74959]:     </system>
Nov 28 23:09:32 user nova-compute[74959]:   </sysinfo>
Nov 28 23:09:32 user nova-compute[74959]:   <os>
Nov 28 23:09:32 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:09:32 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:09:32 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:09:32 user nova-compute[74959]:   </os>
Nov 28 23:09:32 user nova-compute[74959]:   <features>
Nov 28 23:09:32 user nova-compute[74959]:     <acpi/>
Nov 28 23:09:32 user nova-compute[74959]:     <apic/>
Nov 28 23:09:32 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:09:32 user nova-compute[74959]:   </features>
Nov 28 23:09:32 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:09:32 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:09:32 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:09:32 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:09:32 user nova-compute[74959]:   </clock>
Nov 28 23:09:32 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:09:32 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:09:32 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:09:32 user nova-compute[74959]:   </cpu>
Nov 28 23:09:32 user nova-compute[74959]:   <devices>
Nov 28 23:09:32 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:09:32 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:09:32 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk"/>
Nov 28 23:09:32 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:09:32 user nova-compute[74959]:     </disk>
Nov 28 23:09:32 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:09:32 user nova-compute[74959]:       <mac address="fa:16:3e:ef:52:ac"/>
Nov 28 23:09:32 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:09:32 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:09:32 user nova-compute[74959]:       <target dev="tapdb47062d-08"/>
Nov 28 23:09:32 user nova-compute[74959]:     </interface>
Nov 28 23:09:32 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:09:32 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/console.log" append="off"/>
Nov 28 23:09:32 user nova-compute[74959]:     </serial>
Nov 28 23:09:32 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:09:32 user nova-compute[74959]:     <video>
Nov 28 23:09:32 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:09:32 user nova-compute[74959]:     </video>
Nov 28 23:09:32 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:09:32 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:09:32 user nova-compute[74959]:     </rng>
Nov 28 23:09:32 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:09:32 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:09:32 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:09:32 user nova-compute[74959]:     </memballoon>
Nov 28 23:09:32 user nova-compute[74959]:   </devices>
Nov 28 23:09:32 user nova-compute[74959]: </domain>
Nov 28 23:09:32 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1706459353',display_name='tempest-AttachVolumeNegativeTest-server-1706459353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1706459353',id=28,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAMmCF0LQCh7VRVGEbHICZFjofwCOvLd25CBPgLOxDrjGw6O/EUnBLbN2EOOAoJAyGRzBj9Of+7FA+DHf1OHzn4rec/lTg2DE+Uy0Lp0gHntT/2SH4FGpDOSJ16Kbp3GQ==',key_name='tempest-keypair-1358675322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-tygvo02a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=d0c359b5-f676-47a2-9e6e-e83e1813206b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=db47062d-08bc-466e-9e85-472b2c58f9c5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb47062d-08') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG os_vif [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=db47062d-08bc-466e-9e85-472b2c58f9c5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb47062d-08') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0707771-8760-5a50-84f2-5f1e06202395', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb47062d-08, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb47062d-08, col_values=(('qos', UUID('5c755d06-9945-48a1-b7c7-25a27aae0972')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb47062d-08, col_values=(('external_ids', {'iface-id': 'db47062d-08bc-466e-9e85-472b2c58f9c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:52:ac', 'vm-uuid': 'd0c359b5-f676-47a2-9e6e-e83e1813206b'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:32 user nova-compute[74959]: INFO os_vif [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=db47062d-08bc-466e-9e85-472b2c58f9c5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb47062d-08')
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:09:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No VIF found with MAC fa:16:3e:ef:52:ac, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG nova.network.neutron [req-9357f798-95bb-4477-b0c8-7d4d39bd8817 req-7ef0c3e3-69b3-4427-9457-9a837bc2253d service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Updated VIF entry in instance network info cache for port db47062d-08bc-466e-9e85-472b2c58f9c5. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG nova.network.neutron [req-9357f798-95bb-4477-b0c8-7d4d39bd8817 req-7ef0c3e3-69b3-4427-9457-9a837bc2253d service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Updating instance_info_cache with network_info: [{"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9357f798-95bb-4477-b0c8-7d4d39bd8817 req-7ef0c3e3-69b3-4427-9457-9a837bc2253d service nova] Releasing lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:09:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Instance spawned successfully.
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:36 user nova-compute[74959]: INFO nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Took 6.77 seconds to spawn the instance on the hypervisor.
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:09:36 user nova-compute[74959]: INFO nova.compute.manager [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Took 7.63 seconds to build instance.
Nov 28 23:09:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-56684d4b-6107-4308-b98d-46b116704070 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.741s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:36 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:09:36 user nova-compute[74959]: INFO nova.compute.claims [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Claim successful on node user
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:09:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.policy [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b7bfca433f4f1ab07b34aa3b5faa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94592793a8e4345b9357f03062cca9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:09:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Creating image(s)
Nov 28 23:09:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "/opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "/opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "cc0b572a3934c6c91c5d5dcd6899800c14b5099d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "cc0b572a3934c6c91c5d5dcd6899800c14b5099d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Successfully created port: 465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.virt.images [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] d64a9a23-1ca3-4eba-8b25-b69652cc9814 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d.part /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d.part /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d.converted" returned: 0 in 0.315s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "cc0b572a3934c6c91c5d5dcd6899800c14b5099d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.224s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Successfully updated port: 465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquired lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-5540f74b-76e2-4520-bba2-4df7a22c9059 req-8474fe60-05da-4e5b-bbb3-33793f1c6b4a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-5540f74b-76e2-4520-bba2-4df7a22c9059 req-8474fe60-05da-4e5b-bbb3-33793f1c6b4a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing instance network info cache due to event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5540f74b-76e2-4520-bba2-4df7a22c9059 req-8474fe60-05da-4e5b-bbb3-33793f1c6b4a service nova] Acquiring lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "cc0b572a3934c6c91c5d5dcd6899800c14b5099d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "cc0b572a3934c6c91c5d5dcd6899800c14b5099d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d,backing_fmt=raw /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d,backing_fmt=raw /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk 1073741824" returned: 0 in 0.057s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "cc0b572a3934c6c91c5d5dcd6899800c14b5099d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updating instance_info_cache with network_info: [{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.neutron [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Releasing lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Instance network_info: |[{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5540f74b-76e2-4520-bba2-4df7a22c9059 req-8474fe60-05da-4e5b-bbb3-33793f1c6b4a service nova] Acquired lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-5540f74b-76e2-4520-bba2-4df7a22c9059 req-8474fe60-05da-4e5b-bbb3-33793f1c6b4a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Cannot resize image /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Ensure instance console log exists: /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Start _get_guest_xml network_info=[{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T23:09:34Z,direct_url=<?>,disk_format='qcow2',id=d64a9a23-1ca3-4eba-8b25-b69652cc9814,min_disk=0,min_ram=0,name='tempest-scenario-img--1711500149',owner='b94592793a8e4345b9357f03062cca9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T23:09:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'd64a9a23-1ca3-4eba-8b25-b69652cc9814'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:09:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:09:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T23:09:34Z,direct_url=<?>,disk_format='qcow2',id=d64a9a23-1ca3-4eba-8b25-b69652cc9814,min_disk=0,min_ram=0,name='tempest-scenario-img--1711500149',owner='b94592793a8e4345b9357f03062cca9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T23:09:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412234085',display_name='tempest-TestMinimumBasicScenario-server-1412234085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412234085',id=29,image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBau4EJ6PoO60hxDpjDXtquKde7d8Fp4tkYkc6XbpCFwbVop8/hgrcVzm9kBtN1WxHcF6o3d4i5XIQU2FPN6DN/V00LAqAHBgfvo/Kr7i4ZQV5XV/dtZ0mZIaxiaE0AknA==',key_name='tempest-TestMinimumBasicScenario-2066449073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-c4w6rkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:09:37Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=d4c21a2d-bc24-4c8d-9703-7aa61f62713e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.objects.instance [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'pci_devices' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:09:39 user nova-compute[74959]:   <uuid>d4c21a2d-bc24-4c8d-9703-7aa61f62713e</uuid>
Nov 28 23:09:39 user nova-compute[74959]:   <name>instance-0000001d</name>
Nov 28 23:09:39 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:09:39 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:09:39 user nova-compute[74959]:   <metadata>
Nov 28 23:09:39 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:09:39 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:09:39 user nova-compute[74959]:       <nova:name>tempest-TestMinimumBasicScenario-server-1412234085</nova:name>
Nov 28 23:09:39 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:09:39</nova:creationTime>
Nov 28 23:09:39 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:09:39 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:09:39 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:09:39 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:09:39 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:09:39 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:09:39 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:09:39 user nova-compute[74959]:       <nova:owner>
Nov 28 23:09:39 user nova-compute[74959]:         <nova:user uuid="d3b7bfca433f4f1ab07b34aa3b5faa42">tempest-TestMinimumBasicScenario-615443694-project-member</nova:user>
Nov 28 23:09:39 user nova-compute[74959]:         <nova:project uuid="b94592793a8e4345b9357f03062cca9a">tempest-TestMinimumBasicScenario-615443694</nova:project>
Nov 28 23:09:39 user nova-compute[74959]:       </nova:owner>
Nov 28 23:09:39 user nova-compute[74959]:       <nova:root type="image" uuid="d64a9a23-1ca3-4eba-8b25-b69652cc9814"/>
Nov 28 23:09:39 user nova-compute[74959]:       <nova:ports>
Nov 28 23:09:39 user nova-compute[74959]:         <nova:port uuid="465c6e1b-9eb2-470e-8647-8b43d80e945a">
Nov 28 23:09:39 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 23:09:39 user nova-compute[74959]:         </nova:port>
Nov 28 23:09:39 user nova-compute[74959]:       </nova:ports>
Nov 28 23:09:39 user nova-compute[74959]:     </nova:instance>
Nov 28 23:09:39 user nova-compute[74959]:   </metadata>
Nov 28 23:09:39 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:09:39 user nova-compute[74959]:     <system>
Nov 28 23:09:39 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:09:39 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:09:39 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:09:39 user nova-compute[74959]:       <entry name="serial">d4c21a2d-bc24-4c8d-9703-7aa61f62713e</entry>
Nov 28 23:09:39 user nova-compute[74959]:       <entry name="uuid">d4c21a2d-bc24-4c8d-9703-7aa61f62713e</entry>
Nov 28 23:09:39 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:09:39 user nova-compute[74959]:     </system>
Nov 28 23:09:39 user nova-compute[74959]:   </sysinfo>
Nov 28 23:09:39 user nova-compute[74959]:   <os>
Nov 28 23:09:39 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:09:39 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:09:39 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:09:39 user nova-compute[74959]:   </os>
Nov 28 23:09:39 user nova-compute[74959]:   <features>
Nov 28 23:09:39 user nova-compute[74959]:     <acpi/>
Nov 28 23:09:39 user nova-compute[74959]:     <apic/>
Nov 28 23:09:39 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:09:39 user nova-compute[74959]:   </features>
Nov 28 23:09:39 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:09:39 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:09:39 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:09:39 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:09:39 user nova-compute[74959]:   </clock>
Nov 28 23:09:39 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:09:39 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:09:39 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:09:39 user nova-compute[74959]:   </cpu>
Nov 28 23:09:39 user nova-compute[74959]:   <devices>
Nov 28 23:09:39 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:09:39 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:09:39 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk"/>
Nov 28 23:09:39 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:09:39 user nova-compute[74959]:     </disk>
Nov 28 23:09:39 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:09:39 user nova-compute[74959]:       <mac address="fa:16:3e:20:45:49"/>
Nov 28 23:09:39 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:09:39 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:09:39 user nova-compute[74959]:       <target dev="tap465c6e1b-9e"/>
Nov 28 23:09:39 user nova-compute[74959]:     </interface>
Nov 28 23:09:39 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:09:39 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/console.log" append="off"/>
Nov 28 23:09:39 user nova-compute[74959]:     </serial>
Nov 28 23:09:39 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:09:39 user nova-compute[74959]:     <video>
Nov 28 23:09:39 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:09:39 user nova-compute[74959]:     </video>
Nov 28 23:09:39 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:09:39 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:09:39 user nova-compute[74959]:     </rng>
Nov 28 23:09:39 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:09:39 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:09:39 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:09:39 user nova-compute[74959]:     </memballoon>
Nov 28 23:09:39 user nova-compute[74959]:   </devices>
Nov 28 23:09:39 user nova-compute[74959]: </domain>
Nov 28 23:09:39 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412234085',display_name='tempest-TestMinimumBasicScenario-server-1412234085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412234085',id=29,image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBau4EJ6PoO60hxDpjDXtquKde7d8Fp4tkYkc6XbpCFwbVop8/hgrcVzm9kBtN1WxHcF6o3d4i5XIQU2FPN6DN/V00LAqAHBgfvo/Kr7i4ZQV5XV/dtZ0mZIaxiaE0AknA==',key_name='tempest-TestMinimumBasicScenario-2066449073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-c4w6rkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:09:37Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=d4c21a2d-bc24-4c8d-9703-7aa61f62713e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG os_vif [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-5540f74b-76e2-4520-bba2-4df7a22c9059 req-8474fe60-05da-4e5b-bbb3-33793f1c6b4a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updated VIF entry in instance network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-5540f74b-76e2-4520-bba2-4df7a22c9059 req-8474fe60-05da-4e5b-bbb3-33793f1c6b4a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3deb969-36db-5958-99d6-18758da1df56', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap465c6e1b-9e, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap465c6e1b-9e, col_values=(('qos', UUID('48da86b6-032a-4b59-a1c0-d280991bd549')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap465c6e1b-9e, col_values=(('external_ids', {'iface-id': '465c6e1b-9eb2-470e-8647-8b43d80e945a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:45:49', 'vm-uuid': 'd4c21a2d-bc24-4c8d-9703-7aa61f62713e'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5540f74b-76e2-4520-bba2-4df7a22c9059 req-8474fe60-05da-4e5b-bbb3-33793f1c6b4a service nova] Releasing lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:39 user nova-compute[74959]: INFO os_vif [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e')
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:09:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No VIF found with MAC fa:16:3e:20:45:49, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received event network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] No waiting events found dispatching network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:40 user nova-compute[74959]: WARNING nova.compute.manager [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received unexpected event network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 for instance with vm_state active and task_state None.
Nov 28 23:09:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received event network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] No waiting events found dispatching network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:40 user nova-compute[74959]: WARNING nova.compute.manager [req-f897b7ad-a65b-4ff0-9fc0-cc2901be5222 req-1b2eefe7-1121-493b-a7cf-b2083ce0cba8 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received unexpected event network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 for instance with vm_state active and task_state None.
Nov 28 23:09:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] No waiting events found dispatching network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:42 user nova-compute[74959]: WARNING nova.compute.manager [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received unexpected event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a for instance with vm_state building and task_state spawning.
Nov 28 23:09:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] No waiting events found dispatching network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:42 user nova-compute[74959]: WARNING nova.compute.manager [req-1ba868a3-f2c3-4109-a1d2-7d80e2afb680 req-2561bf2d-30da-4e2d-87dc-cb465a561e21 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received unexpected event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a for instance with vm_state building and task_state spawning.
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:09:43 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Instance spawned successfully.
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:43 user nova-compute[74959]: INFO nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:09:43 user nova-compute[74959]: INFO nova.compute.manager [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Took 6.81 seconds to build instance.
Nov 28 23:09:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-76b4f745-5e28-44ea-a48e-aad292b988a8 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.916s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:09:45 user nova-compute[74959]: INFO nova.compute.claims [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Claim successful on node user
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.734s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:09:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:09:45 user nova-compute[74959]: DEBUG nova.policy [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba2c8fce9ab041ba928f65f59468683e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95b70a9bba84ebc95d6d7aea0d8c649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:09:46 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Creating image(s)
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "/opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "/opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk 1073741824" returned: 0 in 0.049s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Successfully created port: 27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.224s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Cannot resize image /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Ensure instance console log exists: /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Successfully updated port: 27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquired lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ea70865-82dd-4ffc-8629-e632a0321cf6 req-44b65a0d-f1ea-4853-935d-315d0de01cb2 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received event network-changed-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-4ea70865-82dd-4ffc-8629-e632a0321cf6 req-44b65a0d-f1ea-4853-935d-315d0de01cb2 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Refreshing instance network info cache due to event network-changed-27d08f4d-04eb-4dcd-ab2f-a5f730917f09. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ea70865-82dd-4ffc-8629-e632a0321cf6 req-44b65a0d-f1ea-4853-935d-315d0de01cb2 service nova] Acquiring lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:48 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:09:48 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.203460693359375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d0c359b5-f676-47a2-9e6e-e83e1813206b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance dc9885ed-08ef-484c-89f6-97e4320217bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Updating instance_info_cache with network_info: [{"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Releasing lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Instance network_info: |[{"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ea70865-82dd-4ffc-8629-e632a0321cf6 req-44b65a0d-f1ea-4853-935d-315d0de01cb2 service nova] Acquired lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-4ea70865-82dd-4ffc-8629-e632a0321cf6 req-44b65a0d-f1ea-4853-935d-315d0de01cb2 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Refreshing network info cache for port 27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Start _get_guest_xml network_info=[{"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:09:48 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:09:48 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-586580815',display_name='tempest-AttachVolumeTestJSON-server-586580815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-586580815',id=30,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCD10hjk4a8cjjPITQ/gaOzg8i2DfIZKTkNGwxTffjnPZSwKAHJBPskMEBL02EvrznCxLxGMUHIK1kGNpdCKSo993mRCw+FhBsS/I23eAOHdYWWQV53QFPz/1KaITZ+8g==',key_name='tempest-keypair-1066556271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-j8oa2ot4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=dc9885ed-08ef-484c-89f6-97e4320217bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:2a,bridge_name='br-int',has_traffic_filtering=True,id=27d08f4d-04eb-4dcd-ab2f-a5f730917f09,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d08f4d-04') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'pci_devices' on Instance uuid dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:09:48 user nova-compute[74959]:   <uuid>dc9885ed-08ef-484c-89f6-97e4320217bc</uuid>
Nov 28 23:09:48 user nova-compute[74959]:   <name>instance-0000001e</name>
Nov 28 23:09:48 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:09:48 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:09:48 user nova-compute[74959]:   <metadata>
Nov 28 23:09:48 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:09:48 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:09:48 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeTestJSON-server-586580815</nova:name>
Nov 28 23:09:48 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:09:48</nova:creationTime>
Nov 28 23:09:48 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:09:48 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:09:48 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:09:48 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:09:48 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:09:48 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:09:48 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:09:48 user nova-compute[74959]:       <nova:owner>
Nov 28 23:09:48 user nova-compute[74959]:         <nova:user uuid="ba2c8fce9ab041ba928f65f59468683e">tempest-AttachVolumeTestJSON-803300239-project-member</nova:user>
Nov 28 23:09:48 user nova-compute[74959]:         <nova:project uuid="c95b70a9bba84ebc95d6d7aea0d8c649">tempest-AttachVolumeTestJSON-803300239</nova:project>
Nov 28 23:09:48 user nova-compute[74959]:       </nova:owner>
Nov 28 23:09:48 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:09:48 user nova-compute[74959]:       <nova:ports>
Nov 28 23:09:48 user nova-compute[74959]:         <nova:port uuid="27d08f4d-04eb-4dcd-ab2f-a5f730917f09">
Nov 28 23:09:48 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:09:48 user nova-compute[74959]:         </nova:port>
Nov 28 23:09:48 user nova-compute[74959]:       </nova:ports>
Nov 28 23:09:48 user nova-compute[74959]:     </nova:instance>
Nov 28 23:09:48 user nova-compute[74959]:   </metadata>
Nov 28 23:09:48 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:09:48 user nova-compute[74959]:     <system>
Nov 28 23:09:48 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:09:48 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:09:48 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:09:48 user nova-compute[74959]:       <entry name="serial">dc9885ed-08ef-484c-89f6-97e4320217bc</entry>
Nov 28 23:09:48 user nova-compute[74959]:       <entry name="uuid">dc9885ed-08ef-484c-89f6-97e4320217bc</entry>
Nov 28 23:09:48 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:09:48 user nova-compute[74959]:     </system>
Nov 28 23:09:48 user nova-compute[74959]:   </sysinfo>
Nov 28 23:09:48 user nova-compute[74959]:   <os>
Nov 28 23:09:48 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:09:48 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:09:48 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:09:48 user nova-compute[74959]:   </os>
Nov 28 23:09:48 user nova-compute[74959]:   <features>
Nov 28 23:09:48 user nova-compute[74959]:     <acpi/>
Nov 28 23:09:48 user nova-compute[74959]:     <apic/>
Nov 28 23:09:48 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:09:48 user nova-compute[74959]:   </features>
Nov 28 23:09:48 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:09:48 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:09:48 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:09:48 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:09:48 user nova-compute[74959]:   </clock>
Nov 28 23:09:48 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:09:48 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:09:48 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:09:48 user nova-compute[74959]:   </cpu>
Nov 28 23:09:48 user nova-compute[74959]:   <devices>
Nov 28 23:09:48 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:09:48 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:09:48 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk"/>
Nov 28 23:09:48 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:09:48 user nova-compute[74959]:     </disk>
Nov 28 23:09:48 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:09:48 user nova-compute[74959]:       <mac address="fa:16:3e:05:e6:2a"/>
Nov 28 23:09:48 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:09:48 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:09:48 user nova-compute[74959]:       <target dev="tap27d08f4d-04"/>
Nov 28 23:09:48 user nova-compute[74959]:     </interface>
Nov 28 23:09:48 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:09:48 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/console.log" append="off"/>
Nov 28 23:09:48 user nova-compute[74959]:     </serial>
Nov 28 23:09:48 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:09:48 user nova-compute[74959]:     <video>
Nov 28 23:09:48 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:09:48 user nova-compute[74959]:     </video>
Nov 28 23:09:48 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:09:48 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:09:48 user nova-compute[74959]:     </rng>
Nov 28 23:09:48 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:09:48 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:09:48 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:09:48 user nova-compute[74959]:     </memballoon>
Nov 28 23:09:48 user nova-compute[74959]:   </devices>
Nov 28 23:09:48 user nova-compute[74959]: </domain>
Nov 28 23:09:48 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-586580815',display_name='tempest-AttachVolumeTestJSON-server-586580815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-586580815',id=30,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCD10hjk4a8cjjPITQ/gaOzg8i2DfIZKTkNGwxTffjnPZSwKAHJBPskMEBL02EvrznCxLxGMUHIK1kGNpdCKSo993mRCw+FhBsS/I23eAOHdYWWQV53QFPz/1KaITZ+8g==',key_name='tempest-keypair-1066556271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-j8oa2ot4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=dc9885ed-08ef-484c-89f6-97e4320217bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:2a,bridge_name='br-int',has_traffic_filtering=True,id=27d08f4d-04eb-4dcd-ab2f-a5f730917f09,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d08f4d-04') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG os_vif [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:2a,bridge_name='br-int',has_traffic_filtering=True,id=27d08f4d-04eb-4dcd-ab2f-a5f730917f09,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d08f4d-04') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0eb2433-b20f-566c-b274-c10b0eadf68d', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27d08f4d-04, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27d08f4d-04, col_values=(('qos', UUID('a86a241a-8006-4598-9b13-10ee0da0c57f')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27d08f4d-04, col_values=(('external_ids', {'iface-id': '27d08f4d-04eb-4dcd-ab2f-a5f730917f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:e6:2a', 'vm-uuid': 'dc9885ed-08ef-484c-89f6-97e4320217bc'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:48 user nova-compute[74959]: INFO os_vif [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e6:2a,bridge_name='br-int',has_traffic_filtering=True,id=27d08f4d-04eb-4dcd-ab2f-a5f730917f09,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d08f4d-04')
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No VIF found with MAC fa:16:3e:05:e6:2a, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-4ea70865-82dd-4ffc-8629-e632a0321cf6 req-44b65a0d-f1ea-4853-935d-315d0de01cb2 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Updated VIF entry in instance network info cache for port 27d08f4d-04eb-4dcd-ab2f-a5f730917f09. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-4ea70865-82dd-4ffc-8629-e632a0321cf6 req-44b65a0d-f1ea-4853-935d-315d0de01cb2 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Updating instance_info_cache with network_info: [{"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:09:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4ea70865-82dd-4ffc-8629-e632a0321cf6 req-44b65a0d-f1ea-4853-935d-315d0de01cb2 service nova] Releasing lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:09:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-88733a09-51f4-40c5-b425-77d3dd0abe25 req-d094b329-cfde-4661-94d0-c5c864f72e6f service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received event network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-88733a09-51f4-40c5-b425-77d3dd0abe25 req-d094b329-cfde-4661-94d0-c5c864f72e6f service nova] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-88733a09-51f4-40c5-b425-77d3dd0abe25 req-d094b329-cfde-4661-94d0-c5c864f72e6f service nova] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-88733a09-51f4-40c5-b425-77d3dd0abe25 req-d094b329-cfde-4661-94d0-c5c864f72e6f service nova] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-88733a09-51f4-40c5-b425-77d3dd0abe25 req-d094b329-cfde-4661-94d0-c5c864f72e6f service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] No waiting events found dispatching network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:50 user nova-compute[74959]: WARNING nova.compute.manager [req-88733a09-51f4-40c5-b425-77d3dd0abe25 req-d094b329-cfde-4661-94d0-c5c864f72e6f service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received unexpected event network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 for instance with vm_state building and task_state spawning.
Nov 28 23:09:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:09:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:09:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:09:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Instance spawned successfully.
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:09:52 user nova-compute[74959]: INFO nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:09:52 user nova-compute[74959]: INFO nova.compute.manager [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Took 7.45 seconds to build instance.
Nov 28 23:09:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c9a1a5f8-0f8b-4c18-b1e2-34bd2b8df24e tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.557s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-29ae40ff-ba40-4943-b123-82900afa3dcd req-bf1f25dd-1934-437a-9299-51caa74addb6 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received event network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-29ae40ff-ba40-4943-b123-82900afa3dcd req-bf1f25dd-1934-437a-9299-51caa74addb6 service nova] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-29ae40ff-ba40-4943-b123-82900afa3dcd req-bf1f25dd-1934-437a-9299-51caa74addb6 service nova] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-29ae40ff-ba40-4943-b123-82900afa3dcd req-bf1f25dd-1934-437a-9299-51caa74addb6 service nova] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:09:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-29ae40ff-ba40-4943-b123-82900afa3dcd req-bf1f25dd-1934-437a-9299-51caa74addb6 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] No waiting events found dispatching network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:09:52 user nova-compute[74959]: WARNING nova.compute.manager [req-29ae40ff-ba40-4943-b123-82900afa3dcd req-bf1f25dd-1934-437a-9299-51caa74addb6 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received unexpected event network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 for instance with vm_state active and task_state None.
Nov 28 23:09:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:09:57 user nova-compute[74959]: INFO nova.compute.manager [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] instance snapshotting
Nov 28 23:09:57 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Beginning live snapshot process
Nov 28 23:09:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json -f qcow2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json -f qcow2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:09:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9kcsif2n/c294ca9c241e40cc8de9f46f6830a925.delta 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:09:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9kcsif2n/c294ca9c241e40cc8de9f46f6830a925.delta 1073741824" returned: 0 in 0.052s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:09:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 23:09:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:09:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] COPY block job progress, current cursor: 22151168 final cursor: 75497472 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:10:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:10:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 23:10:00 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:10:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9kcsif2n/c294ca9c241e40cc8de9f46f6830a925.delta /opt/stack/data/nova/instances/snapshots/tmp9kcsif2n/c294ca9c241e40cc8de9f46f6830a925 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.004s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:00 user nova-compute[74959]: INFO nova.compute.manager [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Unshelving
Nov 28 23:10:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'pci_requests' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:10:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'numa_topology' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:10:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:10:00 user nova-compute[74959]: INFO nova.compute.claims [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Claim successful on node user
Nov 28 23:10:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9kcsif2n/c294ca9c241e40cc8de9f46f6830a925.delta /opt/stack/data/nova/instances/snapshots/tmp9kcsif2n/c294ca9c241e40cc8de9f46f6830a925" returned: 0 in 0.407s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Snapshot extracted, beginning image upload
Nov 28 23:10:01 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:01 user nova-compute[74959]: INFO nova.network.neutron [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquired lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-a22b10f5-0c0b-43e7-95a9-924f1d5d352a req-492e5863-cd3b-4b76-8e13-fdaaa99f4345 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-changed-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-a22b10f5-0c0b-43e7-95a9-924f1d5d352a req-492e5863-cd3b-4b76-8e13-fdaaa99f4345 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Refreshing instance network info cache due to event network-changed-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:10:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a22b10f5-0c0b-43e7-95a9-924f1d5d352a req-492e5863-cd3b-4b76-8e13-fdaaa99f4345 service nova] Acquiring lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Releasing lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:10:02 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Creating image(s)
Nov 28 23:10:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'trusted_certs' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a22b10f5-0c0b-43e7-95a9-924f1d5d352a req-492e5863-cd3b-4b76-8e13-fdaaa99f4345 service nova] Acquired lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-a22b10f5-0c0b-43e7-95a9-924f1d5d352a req-492e5863-cd3b-4b76-8e13-fdaaa99f4345 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Refreshing network info cache for port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG nova.objects.base [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<f180b6b0-ff56-4d28-9a5d-06244e04c1f5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "68181c69da0682928052f35cfac153d13aebfe36" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "68181c69da0682928052f35cfac153d13aebfe36" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36.part --force-share --output=json" returned: 0 in 0.210s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG nova.virt.images [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] 45862211-64b2-4fa5-ae24-c8dc7d9926a4 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36.part /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-a22b10f5-0c0b-43e7-95a9-924f1d5d352a req-492e5863-cd3b-4b76-8e13-fdaaa99f4345 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updated VIF entry in instance network info cache for port fe6d4f6a-611a-4d09-abcc-053f06cb6e4f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-a22b10f5-0c0b-43e7-95a9-924f1d5d352a req-492e5863-cd3b-4b76-8e13-fdaaa99f4345 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a22b10f5-0c0b-43e7-95a9-924f1d5d352a req-492e5863-cd3b-4b76-8e13-fdaaa99f4345 service nova] Releasing lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:10:03 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Snapshot image upload complete
Nov 28 23:10:03 user nova-compute[74959]: INFO nova.compute.manager [None req-77083adc-82bd-4f27-ad7b-ab594a0f29db tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Took 6.03 seconds to snapshot the instance on the hypervisor.
Nov 28 23:10:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36.part /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36.converted" returned: 0 in 0.263s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "68181c69da0682928052f35cfac153d13aebfe36" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.670s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 --force-share --output=json" returned: 0 in 0.168s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "68181c69da0682928052f35cfac153d13aebfe36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "68181c69da0682928052f35cfac153d13aebfe36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 --force-share --output=json" returned: 0 in 0.204s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36,backing_fmt=raw /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36,backing_fmt=raw /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk 1073741824" returned: 0 in 0.060s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "68181c69da0682928052f35cfac153d13aebfe36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 --force-share --output=json" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG nova.objects.instance [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'migration_context' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG nova.objects.base [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<f180b6b0-ff56-4d28-9a5d-06244e04c1f5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:10:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Rebasing disk image.
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 -F raw /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 -F raw /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk" returned: 0 in 2.487s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Ensure instance console log exists: /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Start _get_guest_xml network_info=[{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0f96de9fe9aef577900d97a74149dbb2',container_format='bare',created_at=2023-11-28T23:08:07Z,direct_url=<?>,disk_format='qcow2',id=45862211-64b2-4fa5-ae24-c8dc7d9926a4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1977703593-shelved',owner='bef225be98f448b69f250a21c002c237',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T23:08:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:10:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:10:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0f96de9fe9aef577900d97a74149dbb2',container_format='bare',created_at=2023-11-28T23:08:07Z,direct_url=<?>,disk_format='qcow2',id=45862211-64b2-4fa5-ae24-c8dc7d9926a4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1977703593-shelved',owner='bef225be98f448b69f250a21c002c237',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T23:08:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.objects.instance [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'vcpu_model' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.objects.base [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<f180b6b0-ff56-4d28-9a5d-06244e04c1f5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1977703593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1977703593',id=23,image_ref='45862211-64b2-4fa5-ae24-c8dc7d9926a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-488060459',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-gphxhirs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member',shelved_at='2023-11-28T23:08:12.632150',shelved_host='user',shelved_image_id='45862211-64b2-4fa5-ae24-c8dc7d9926a4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:10:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=f180b6b0-ff56-4d28-9a5d-06244e04c1f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.objects.instance [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'pci_devices' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.objects.base [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Object Instance<f180b6b0-ff56-4d28-9a5d-06244e04c1f5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:10:07 user nova-compute[74959]:   <uuid>f180b6b0-ff56-4d28-9a5d-06244e04c1f5</uuid>
Nov 28 23:10:07 user nova-compute[74959]:   <name>instance-00000017</name>
Nov 28 23:10:07 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:10:07 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:10:07 user nova-compute[74959]:   <metadata>
Nov 28 23:10:07 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:10:07 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:10:07 user nova-compute[74959]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1977703593</nova:name>
Nov 28 23:10:07 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:10:07</nova:creationTime>
Nov 28 23:10:07 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:10:07 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:10:07 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:10:07 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:10:07 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:10:07 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:10:07 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:10:07 user nova-compute[74959]:       <nova:owner>
Nov 28 23:10:07 user nova-compute[74959]:         <nova:user uuid="ecd0185bcfae4e058dade500ad82dbd2">tempest-AttachVolumeShelveTestJSON-533572635-project-member</nova:user>
Nov 28 23:10:07 user nova-compute[74959]:         <nova:project uuid="bef225be98f448b69f250a21c002c237">tempest-AttachVolumeShelveTestJSON-533572635</nova:project>
Nov 28 23:10:07 user nova-compute[74959]:       </nova:owner>
Nov 28 23:10:07 user nova-compute[74959]:       <nova:root type="image" uuid="45862211-64b2-4fa5-ae24-c8dc7d9926a4"/>
Nov 28 23:10:07 user nova-compute[74959]:       <nova:ports>
Nov 28 23:10:07 user nova-compute[74959]:         <nova:port uuid="fe6d4f6a-611a-4d09-abcc-053f06cb6e4f">
Nov 28 23:10:07 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:10:07 user nova-compute[74959]:         </nova:port>
Nov 28 23:10:07 user nova-compute[74959]:       </nova:ports>
Nov 28 23:10:07 user nova-compute[74959]:     </nova:instance>
Nov 28 23:10:07 user nova-compute[74959]:   </metadata>
Nov 28 23:10:07 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:10:07 user nova-compute[74959]:     <system>
Nov 28 23:10:07 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:10:07 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:10:07 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:10:07 user nova-compute[74959]:       <entry name="serial">f180b6b0-ff56-4d28-9a5d-06244e04c1f5</entry>
Nov 28 23:10:07 user nova-compute[74959]:       <entry name="uuid">f180b6b0-ff56-4d28-9a5d-06244e04c1f5</entry>
Nov 28 23:10:07 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:10:07 user nova-compute[74959]:     </system>
Nov 28 23:10:07 user nova-compute[74959]:   </sysinfo>
Nov 28 23:10:07 user nova-compute[74959]:   <os>
Nov 28 23:10:07 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:10:07 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:10:07 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:10:07 user nova-compute[74959]:   </os>
Nov 28 23:10:07 user nova-compute[74959]:   <features>
Nov 28 23:10:07 user nova-compute[74959]:     <acpi/>
Nov 28 23:10:07 user nova-compute[74959]:     <apic/>
Nov 28 23:10:07 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:10:07 user nova-compute[74959]:   </features>
Nov 28 23:10:07 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:10:07 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:10:07 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:10:07 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:10:07 user nova-compute[74959]:   </clock>
Nov 28 23:10:07 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:10:07 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:10:07 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:10:07 user nova-compute[74959]:   </cpu>
Nov 28 23:10:07 user nova-compute[74959]:   <devices>
Nov 28 23:10:07 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:10:07 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:10:07 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk"/>
Nov 28 23:10:07 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:10:07 user nova-compute[74959]:     </disk>
Nov 28 23:10:07 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:10:07 user nova-compute[74959]:       <mac address="fa:16:3e:56:0c:e2"/>
Nov 28 23:10:07 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:10:07 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:10:07 user nova-compute[74959]:       <target dev="tapfe6d4f6a-61"/>
Nov 28 23:10:07 user nova-compute[74959]:     </interface>
Nov 28 23:10:07 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:10:07 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/console.log" append="off"/>
Nov 28 23:10:07 user nova-compute[74959]:     </serial>
Nov 28 23:10:07 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:10:07 user nova-compute[74959]:     <video>
Nov 28 23:10:07 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:10:07 user nova-compute[74959]:     </video>
Nov 28 23:10:07 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:10:07 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:10:07 user nova-compute[74959]:     </rng>
Nov 28 23:10:07 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:10:07 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:10:07 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:10:07 user nova-compute[74959]:     </memballoon>
Nov 28 23:10:07 user nova-compute[74959]:   </devices>
Nov 28 23:10:07 user nova-compute[74959]: </domain>
Nov 28 23:10:07 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1977703593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1977703593',id=23,image_ref='45862211-64b2-4fa5-ae24-c8dc7d9926a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-488060459',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-gphxhirs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member',shelved_at='2023-11-28T23:08:12.632150',shelved_host='user',shelved_image_id='45862211-64b2-4fa5-ae24-c8dc7d9926a4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:10:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=f180b6b0-ff56-4d28-9a5d-06244e04c1f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG os_vif [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '585b0cc5-c69c-5b8e-8422-759ea1164585', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe6d4f6a-61, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe6d4f6a-61, col_values=(('qos', UUID('ead01097-679f-45db-ad4f-3249bef9289c')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe6d4f6a-61, col_values=(('external_ids', {'iface-id': 'fe6d4f6a-611a-4d09-abcc-053f06cb6e4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:0c:e2', 'vm-uuid': 'f180b6b0-ff56-4d28-9a5d-06244e04c1f5'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:07 user nova-compute[74959]: INFO os_vif [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61')
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:10:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] No VIF found with MAC fa:16:3e:56:0c:e2, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:10:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-154219d2-d950-4709-9f25-0a85b8f83259 req-3eb54aa7-043d-41e5-9bb1-c0d63812be6f service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-154219d2-d950-4709-9f25-0a85b8f83259 req-3eb54aa7-043d-41e5-9bb1-c0d63812be6f service nova] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-154219d2-d950-4709-9f25-0a85b8f83259 req-3eb54aa7-043d-41e5-9bb1-c0d63812be6f service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-154219d2-d950-4709-9f25-0a85b8f83259 req-3eb54aa7-043d-41e5-9bb1-c0d63812be6f service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-154219d2-d950-4709-9f25-0a85b8f83259 req-3eb54aa7-043d-41e5-9bb1-c0d63812be6f service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] No waiting events found dispatching network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:10:09 user nova-compute[74959]: WARNING nova.compute.manager [req-154219d2-d950-4709-9f25-0a85b8f83259 req-3eb54aa7-043d-41e5-9bb1-c0d63812be6f service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received unexpected event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 23:10:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:10:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:10:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance spawned successfully.
Nov 28 23:10:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-d0c6be1c-e594-4055-8630-9e1de0a4b8ec req-781dd95f-c824-4e78-88ff-e5108cc9c522 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:10:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0c6be1c-e594-4055-8630-9e1de0a4b8ec req-781dd95f-c824-4e78-88ff-e5108cc9c522 service nova] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0c6be1c-e594-4055-8630-9e1de0a4b8ec req-781dd95f-c824-4e78-88ff-e5108cc9c522 service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d0c6be1c-e594-4055-8630-9e1de0a4b8ec req-781dd95f-c824-4e78-88ff-e5108cc9c522 service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-d0c6be1c-e594-4055-8630-9e1de0a4b8ec req-781dd95f-c824-4e78-88ff-e5108cc9c522 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] No waiting events found dispatching network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:10:11 user nova-compute[74959]: WARNING nova.compute.manager [req-d0c6be1c-e594-4055-8630-9e1de0a4b8ec req-781dd95f-c824-4e78-88ff-e5108cc9c522 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received unexpected event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 23:10:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:10:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-11f984c8-410b-4556-b2c7-a3200bb00514 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.007s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-51dff77a-caee-4726-a96d-ad3a25e8a915 req-ae5dbf74-8c06-41f9-9aab-947013167698 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-changed-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:10:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-51dff77a-caee-4726-a96d-ad3a25e8a915 req-ae5dbf74-8c06-41f9-9aab-947013167698 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Refreshing instance network info cache due to event network-changed-c897ce7f-6b41-4c61-9e90-56577c38cac7. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:10:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-51dff77a-caee-4726-a96d-ad3a25e8a915 req-ae5dbf74-8c06-41f9-9aab-947013167698 service nova] Acquiring lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:10:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-51dff77a-caee-4726-a96d-ad3a25e8a915 req-ae5dbf74-8c06-41f9-9aab-947013167698 service nova] Acquired lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:10:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-51dff77a-caee-4726-a96d-ad3a25e8a915 req-ae5dbf74-8c06-41f9-9aab-947013167698 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Refreshing network info cache for port c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:10:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-51dff77a-caee-4726-a96d-ad3a25e8a915 req-ae5dbf74-8c06-41f9-9aab-947013167698 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updated VIF entry in instance network info cache for port c897ce7f-6b41-4c61-9e90-56577c38cac7. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:10:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-51dff77a-caee-4726-a96d-ad3a25e8a915 req-ae5dbf74-8c06-41f9-9aab-947013167698 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating instance_info_cache with network_info: [{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:10:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-51dff77a-caee-4726-a96d-ad3a25e8a915 req-ae5dbf74-8c06-41f9-9aab-947013167698 service nova] Releasing lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG nova.compute.manager [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:10:40 user nova-compute[74959]: INFO nova.compute.manager [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] instance snapshotting
Nov 28 23:10:40 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Beginning live snapshot process
Nov 28 23:10:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json -f qcow2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json -f qcow2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9vj1wwyt/a21cbce952af4970a6c5b6ff5e7d82b8.delta 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9vj1wwyt/a21cbce952af4970a6c5b6ff5e7d82b8.delta 1073741824" returned: 0 in 0.049s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:41 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 23:10:41 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updating instance_info_cache with network_info: [{"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:10:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:10:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 23:10:42 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:10:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9vj1wwyt/a21cbce952af4970a6c5b6ff5e7d82b8.delta /opt/stack/data/nova/instances/snapshots/tmp9vj1wwyt/a21cbce952af4970a6c5b6ff5e7d82b8 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9vj1wwyt/a21cbce952af4970a6c5b6ff5e7d82b8.delta /opt/stack/data/nova/instances/snapshots/tmp9vj1wwyt/a21cbce952af4970a6c5b6ff5e7d82b8" returned: 0 in 0.459s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Snapshot extracted, beginning image upload
Nov 28 23:10:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Snapshot image upload complete
Nov 28 23:10:45 user nova-compute[74959]: INFO nova.compute.manager [None req-90e68958-e556-4ae5-b480-3c5722d8d13a tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Took 4.96 seconds to snapshot the instance on the hypervisor.
Nov 28 23:10:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:10:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:47 user nova-compute[74959]: INFO nova.compute.manager [None req-441481ff-096d-4fe8-aeab-a788f5cf5e83 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Unrescuing
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-441481ff-096d-4fe8-aeab-a788f5cf5e83 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-441481ff-096d-4fe8-aeab-a788f5cf5e83 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquired lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-441481ff-096d-4fe8-aeab-a788f5cf5e83 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-441481ff-096d-4fe8-aeab-a788f5cf5e83 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updating instance_info_cache with network_info: [{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-441481ff-096d-4fe8-aeab-a788f5cf5e83 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Releasing lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG nova.objects.instance [None req-441481ff-096d-4fe8-aeab-a788f5cf5e83 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'flavor' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-0038a6ef-60ff-48da-a0bc-f1dc191a2ecc req-0158d7bc-f90b-4382-9a58-f4732e0d2f56 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0038a6ef-60ff-48da-a0bc-f1dc191a2ecc req-0158d7bc-f90b-4382-9a58-f4732e0d2f56 service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0038a6ef-60ff-48da-a0bc-f1dc191a2ecc req-0158d7bc-f90b-4382-9a58-f4732e0d2f56 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0038a6ef-60ff-48da-a0bc-f1dc191a2ecc req-0158d7bc-f90b-4382-9a58-f4732e0d2f56 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-0038a6ef-60ff-48da-a0bc-f1dc191a2ecc req-0158d7bc-f90b-4382-9a58-f4732e0d2f56 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:10:48 user nova-compute[74959]: WARNING nova.compute.manager [req-0038a6ef-60ff-48da-a0bc-f1dc191a2ecc req-0158d7bc-f90b-4382-9a58-f4732e0d2f56 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance destroyed successfully.
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:10:52 user nova-compute[74959]: WARNING nova.compute.manager [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:10:52 user nova-compute[74959]: WARNING nova.compute.manager [req-f4bfdb12-d330-4230-8407-9d615e640b4f req-53163606-b9e1-4010-9b81-6a5a52bfaeae service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-441481ff-096d-4fe8-aeab-a788f5cf5e83 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:10:52 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:10:52 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7400MB free_disk=24.985919952392578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:52 user nova-compute[74959]: INFO nova.compute.manager [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Unshelving
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-06c83d2a-15b6-4121-9239-4e3e0c33c0e9 req-81611ca3-696e-4abd-8f5f-b2a4b7774629 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06c83d2a-15b6-4121-9239-4e3e0c33c0e9 req-81611ca3-696e-4abd-8f5f-b2a4b7774629 service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06c83d2a-15b6-4121-9239-4e3e0c33c0e9 req-81611ca3-696e-4abd-8f5f-b2a4b7774629 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06c83d2a-15b6-4121-9239-4e3e0c33c0e9 req-81611ca3-696e-4abd-8f5f-b2a4b7774629 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-06c83d2a-15b6-4121-9239-4e3e0c33c0e9 req-81611ca3-696e-4abd-8f5f-b2a4b7774629 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:10:52 user nova-compute[74959]: WARNING nova.compute.manager [req-06c83d2a-15b6-4121-9239-4e3e0c33c0e9 req-81611ca3-696e-4abd-8f5f-b2a4b7774629 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state active and task_state None.
Nov 28 23:10:52 user nova-compute[74959]: INFO nova.virt.block_device [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Booting with volume f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d at /dev/vda
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d0c359b5-f676-47a2-9e6e-e83e1813206b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance dc9885ed-08ef-484c-89f6-97e4320217bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance f180b6b0-ff56-4d28-9a5d-06244e04c1f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 0bf7ba2c-355f-4ee4-8937-ad80724df48f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG os_brick.utils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69cc544-c654-4c2c-bdc4-5bbb03e63191]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8986a3bf-40d6-49fe-a2ec-11e1203c5df7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe86e3d-e992-485c-a7de-5c5a5005acc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5081e55-7244-4d9a-ae04-b2b565209ea6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:10:52 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:10:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af65cc0-f149-42e3-8d33-7f019ea124db]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG os_brick.utils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:10:52 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating existing volume attachment record: e208f59b-1e14-44a3-8652-cb233492e7f6 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:10:53 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:10:53 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:10:53 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:10:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:10:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:10:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:10:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:10:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lazy-loading 'pci_requests' on Instance uuid 0bf7ba2c-355f-4ee4-8937-ad80724df48f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lazy-loading 'numa_topology' on Instance uuid 0bf7ba2c-355f-4ee4-8937-ad80724df48f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:11:00 user nova-compute[74959]: INFO nova.compute.claims [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Claim successful on node user
Nov 28 23:11:00 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:11:00 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:11:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:00 user nova-compute[74959]: INFO nova.network.neutron [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquired lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-e4e634f9-2f7d-4b48-844d-b1b6e1ac22f5 req-b6629124-ac99-4b34-a099-c1e71bbe383c service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-e4e634f9-2f7d-4b48-844d-b1b6e1ac22f5 req-b6629124-ac99-4b34-a099-c1e71bbe383c service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing instance network info cache due to event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e4e634f9-2f7d-4b48-844d-b1b6e1ac22f5 req-b6629124-ac99-4b34-a099-c1e71bbe383c service nova] Acquiring lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Releasing lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:11:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Creating image(s)
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Ensure instance console log exists: /opt/stack/data/nova/instances/0bf7ba2c-355f-4ee4-8937-ad80724df48f/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Start _get_guest_xml network_info=[{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePFtYNkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0bf7ba2c-355f-4ee4-8937-ad80724df48f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'serial': 'f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'e208f59b-1e14-44a3-8652-cb233492e7f6', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e4e634f9-2f7d-4b48-844d-b1b6e1ac22f5 req-b6629124-ac99-4b34-a099-c1e71bbe383c service nova] Acquired lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.network.neutron [req-e4e634f9-2f7d-4b48-844d-b1b6e1ac22f5 req-b6629124-ac99-4b34-a099-c1e71bbe383c service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:11:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0bf7ba2c-355f-4ee4-8937-ad80724df48f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.objects.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Object Instance<0bf7ba2c-355f-4ee4-8937-ad80724df48f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePFtYNkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:01 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:01 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:01 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6504bee-4099-42ba-8289-f40a921339f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:11:01 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.064s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb2b034-594d-4eb4-8b67-37326e2b00c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d] added
Nov 28 23:11:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[54208de2-c92a-4257-9fd1-161541ff24f3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee5bc2e-db85-48db-b9e4-c0c354beef75]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePFtYNkg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ePFtYNkg" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd931d-dc72-4a99-8926-39a93ba488a6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ePFtYNkg'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb8b12-7b29-4204-8ada-c1aec09a5dca]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6d7a68-84cd-4dfc-8605-1bbea3036ef4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[633c5385-e44e-406f-9661-f6b8806ab013]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260]
Nov 28 23:11:01 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260] successful.
Nov 28 23:11:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e882b2cd-8913-4e46-82df-8e987536859f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e347ca-98a6-4fd1-bea8-bfdfd4362ded]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:01 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:02 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:02 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-e4e634f9-2f7d-4b48-844d-b1b6e1ac22f5 req-b6629124-ac99-4b34-a099-c1e71bbe383c service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updated VIF entry in instance network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG nova.network.neutron [req-e4e634f9-2f7d-4b48-844d-b1b6e1ac22f5 req-b6629124-ac99-4b34-a099-c1e71bbe383c service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e054441-f194-41d4-8006-b4de329728ac]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePFtYNkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e4e634f9-2f7d-4b48-844d-b1b6e1ac22f5 req-b6629124-ac99-4b34-a099-c1e71bbe383c service nova] Releasing lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:11:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26563613532376232', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563613532376232', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1099925087',display_name='tempest-TestShelveInstance-server-1099925087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1099925087',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1413730831',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2e326f1cb3b64f78b1cd0ef5adc09323',ramdisk_id='',reservation_id='r-owauny1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-19474985',owner_user_name='tempest-TestShelveInstance-19474985-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:10:53Z,user_data=None,user_id='305832e59f9846b2923717725a362cbc',uuid=0bf7ba2c-355f-4ee4-8937-ad80724df48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converting VIF {"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.objects.instance [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bf7ba2c-355f-4ee4-8937-ad80724df48f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.objects.base [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Object Instance<0bf7ba2c-355f-4ee4-8937-ad80724df48f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:11:03 user nova-compute[74959]:   <uuid>0bf7ba2c-355f-4ee4-8937-ad80724df48f</uuid>
Nov 28 23:11:03 user nova-compute[74959]:   <name>instance-00000018</name>
Nov 28 23:11:03 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:11:03 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:11:03 user nova-compute[74959]:   <metadata>
Nov 28 23:11:03 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:11:03 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:11:03 user nova-compute[74959]:       <nova:name>tempest-TestShelveInstance-server-1099925087</nova:name>
Nov 28 23:11:03 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:11:01</nova:creationTime>
Nov 28 23:11:03 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:11:03 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:11:03 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:11:03 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:11:03 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:11:03 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:11:03 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:11:03 user nova-compute[74959]:       <nova:owner>
Nov 28 23:11:03 user nova-compute[74959]:         <nova:user uuid="305832e59f9846b2923717725a362cbc">tempest-TestShelveInstance-19474985-project-member</nova:user>
Nov 28 23:11:03 user nova-compute[74959]:         <nova:project uuid="2e326f1cb3b64f78b1cd0ef5adc09323">tempest-TestShelveInstance-19474985</nova:project>
Nov 28 23:11:03 user nova-compute[74959]:       </nova:owner>
Nov 28 23:11:03 user nova-compute[74959]:       <nova:ports>
Nov 28 23:11:03 user nova-compute[74959]:         <nova:port uuid="8b4e208b-60ed-496c-9c2a-94a3ec2bc70f">
Nov 28 23:11:03 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:11:03 user nova-compute[74959]:         </nova:port>
Nov 28 23:11:03 user nova-compute[74959]:       </nova:ports>
Nov 28 23:11:03 user nova-compute[74959]:     </nova:instance>
Nov 28 23:11:03 user nova-compute[74959]:   </metadata>
Nov 28 23:11:03 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:11:03 user nova-compute[74959]:     <system>
Nov 28 23:11:03 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:11:03 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:11:03 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:11:03 user nova-compute[74959]:       <entry name="serial">0bf7ba2c-355f-4ee4-8937-ad80724df48f</entry>
Nov 28 23:11:03 user nova-compute[74959]:       <entry name="uuid">0bf7ba2c-355f-4ee4-8937-ad80724df48f</entry>
Nov 28 23:11:03 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:11:03 user nova-compute[74959]:     </system>
Nov 28 23:11:03 user nova-compute[74959]:   </sysinfo>
Nov 28 23:11:03 user nova-compute[74959]:   <os>
Nov 28 23:11:03 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:11:03 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:11:03 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:11:03 user nova-compute[74959]:   </os>
Nov 28 23:11:03 user nova-compute[74959]:   <features>
Nov 28 23:11:03 user nova-compute[74959]:     <acpi/>
Nov 28 23:11:03 user nova-compute[74959]:     <apic/>
Nov 28 23:11:03 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:11:03 user nova-compute[74959]:   </features>
Nov 28 23:11:03 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:11:03 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:11:03 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:11:03 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:11:03 user nova-compute[74959]:   </clock>
Nov 28 23:11:03 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:11:03 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:11:03 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:11:03 user nova-compute[74959]:   </cpu>
Nov 28 23:11:03 user nova-compute[74959]:   <devices>
Nov 28 23:11:03 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:11:03 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:11:03 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:11:03 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:11:03 user nova-compute[74959]:       <serial>f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d</serial>
Nov 28 23:11:03 user nova-compute[74959]:     </disk>
Nov 28 23:11:03 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:11:03 user nova-compute[74959]:       <mac address="fa:16:3e:4c:d6:dd"/>
Nov 28 23:11:03 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:11:03 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:11:03 user nova-compute[74959]:       <target dev="tap8b4e208b-60"/>
Nov 28 23:11:03 user nova-compute[74959]:     </interface>
Nov 28 23:11:03 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:11:03 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/0bf7ba2c-355f-4ee4-8937-ad80724df48f/console.log" append="off"/>
Nov 28 23:11:03 user nova-compute[74959]:     </serial>
Nov 28 23:11:03 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:11:03 user nova-compute[74959]:     <video>
Nov 28 23:11:03 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:11:03 user nova-compute[74959]:     </video>
Nov 28 23:11:03 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:11:03 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:11:03 user nova-compute[74959]:     </rng>
Nov 28 23:11:03 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:11:03 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:11:03 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:11:03 user nova-compute[74959]:     </memballoon>
Nov 28 23:11:03 user nova-compute[74959]:   </devices>
Nov 28 23:11:03 user nova-compute[74959]: </domain>
Nov 28 23:11:03 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1099925087',display_name='tempest-TestShelveInstance-server-1099925087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1099925087',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1413730831',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2e326f1cb3b64f78b1cd0ef5adc09323',ramdisk_id='',reservation_id='r-owauny1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-19474985',owner_user_name='tempest-TestShelveInstance-19474985-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:10:53Z,user_data=None,user_id='305832e59f9846b2923717725a362cbc',uuid=0bf7ba2c-355f-4ee4-8937-ad80724df48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converting VIF {"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG os_vif [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af17fab4-b679-5d95-8d31-300f7c8e118f', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4e208b-60, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b4e208b-60, col_values=(('qos', UUID('537f6ddc-ef91-430b-881c-6767ca16e4c6')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b4e208b-60, col_values=(('external_ids', {'iface-id': '8b4e208b-60ed-496c-9c2a-94a3ec2bc70f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:d6:dd', 'vm-uuid': '0bf7ba2c-355f-4ee4-8937-ad80724df48f'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:03 user nova-compute[74959]: INFO os_vif [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60')
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] No VIF found with MAC fa:16:3e:4c:d6:dd, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:11:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-ed5ed645-4b33-46f2-ab21-2295da234169 req-d93ba8df-b361-47b8-815c-a9645554e72d service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ed5ed645-4b33-46f2-ab21-2295da234169 req-d93ba8df-b361-47b8-815c-a9645554e72d service nova] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ed5ed645-4b33-46f2-ab21-2295da234169 req-d93ba8df-b361-47b8-815c-a9645554e72d service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ed5ed645-4b33-46f2-ab21-2295da234169 req-d93ba8df-b361-47b8-815c-a9645554e72d service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-ed5ed645-4b33-46f2-ab21-2295da234169 req-d93ba8df-b361-47b8-815c-a9645554e72d service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] No waiting events found dispatching network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:04 user nova-compute[74959]: WARNING nova.compute.manager [req-ed5ed645-4b33-46f2-ab21-2295da234169 req-d93ba8df-b361-47b8-815c-a9645554e72d service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received unexpected event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 23:11:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:05 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:11:05 user nova-compute[74959]: INFO nova.compute.claims [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Claim successful on node user
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.policy [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8d218abbe14f27b754f1fffd9553f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da22f0050e34c9b9a7658f16c08f28b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:11:06 user nova-compute[74959]: INFO nova.virt.block_device [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Booting with volume-backed-image dd44e43d-57fb-483e-b625-10657e7fc425 at /dev/vda
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:11:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance spawned successfully.
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bdf89a63-a615-4bf2-a19d-88fd886ca51e tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.256s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-f0c6e5e8-dcca-4cf7-9e41-b5e1ffe0bf93 req-6f2d6ecf-a451-4151-9c74-f31055baeca0 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f0c6e5e8-dcca-4cf7-9e41-b5e1ffe0bf93 req-6f2d6ecf-a451-4151-9c74-f31055baeca0 service nova] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f0c6e5e8-dcca-4cf7-9e41-b5e1ffe0bf93 req-6f2d6ecf-a451-4151-9c74-f31055baeca0 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f0c6e5e8-dcca-4cf7-9e41-b5e1ffe0bf93 req-6f2d6ecf-a451-4151-9c74-f31055baeca0 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-f0c6e5e8-dcca-4cf7-9e41-b5e1ffe0bf93 req-6f2d6ecf-a451-4151-9c74-f31055baeca0 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] No waiting events found dispatching network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:06 user nova-compute[74959]: WARNING nova.compute.manager [req-f0c6e5e8-dcca-4cf7-9e41-b5e1ffe0bf93 req-6f2d6ecf-a451-4151-9c74-f31055baeca0 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received unexpected event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f for instance with vm_state active and task_state None.
Nov 28 23:11:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Successfully created port: 47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:11:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Successfully updated port: 47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:11:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquired lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:07 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Updating instance_info_cache with network_info: [{"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Releasing lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance network_info: |[{"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:11:08 user nova-compute[74959]: INFO nova.compute.claims [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Claim successful on node user
Nov 28 23:11:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-7f251744-813f-4039-b78f-eb79646956a3 req-c6ba3d4d-4d7d-4182-ba42-74655c59e779 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-changed-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-7f251744-813f-4039-b78f-eb79646956a3 req-c6ba3d4d-4d7d-4182-ba42-74655c59e779 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Refreshing instance network info cache due to event network-changed-47fc4ac0-57b6-463f-b77d-daa68b8abdeb. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7f251744-813f-4039-b78f-eb79646956a3 req-c6ba3d4d-4d7d-4182-ba42-74655c59e779 service nova] Acquiring lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7f251744-813f-4039-b78f-eb79646956a3 req-c6ba3d4d-4d7d-4182-ba42-74655c59e779 service nova] Acquired lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:08 user nova-compute[74959]: DEBUG nova.network.neutron [req-7f251744-813f-4039-b78f-eb79646956a3 req-c6ba3d4d-4d7d-4182-ba42-74655c59e779 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Refreshing network info cache for port 47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.network.neutron [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:11:09 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.policy [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73af90e11a374c9cbf0a58db8410e245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac0d1f399f040f98098e84ac875c1fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:11:09 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Creating image(s)
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.205s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.network.neutron [req-7f251744-813f-4039-b78f-eb79646956a3 req-c6ba3d4d-4d7d-4182-ba42-74655c59e779 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Updated VIF entry in instance network info cache for port 47fc4ac0-57b6-463f-b77d-daa68b8abdeb. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.network.neutron [req-7f251744-813f-4039-b78f-eb79646956a3 req-c6ba3d4d-4d7d-4182-ba42-74655c59e779 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Updating instance_info_cache with network_info: [{"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.207s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7f251744-813f-4039-b78f-eb79646956a3 req-c6ba3d4d-4d7d-4182-ba42-74655c59e779 service nova] Releasing lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk 1073741824" returned: 0 in 0.058s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:09 user nova-compute[74959]: DEBUG nova.network.neutron [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Successfully created port: cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.204s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Cannot resize image /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Ensure instance console log exists: /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Successfully updated port: cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquired lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-b7fdb36f-3bcb-48bc-b531-f701df9c3935 req-de4dfc3b-eac8-4f93-b75f-c26cf9272e12 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-changed-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-b7fdb36f-3bcb-48bc-b531-f701df9c3935 req-de4dfc3b-eac8-4f93-b75f-c26cf9272e12 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Refreshing instance network info cache due to event network-changed-cfe2d164-f283-4339-a4ea-8732b732ce64. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b7fdb36f-3bcb-48bc-b531-f701df9c3935 req-de4dfc3b-eac8-4f93-b75f-c26cf9272e12 service nova] Acquiring lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updating instance_info_cache with network_info: [{"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Releasing lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance network_info: |[{"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b7fdb36f-3bcb-48bc-b531-f701df9c3935 req-de4dfc3b-eac8-4f93-b75f-c26cf9272e12 service nova] Acquired lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:10 user nova-compute[74959]: DEBUG nova.network.neutron [req-b7fdb36f-3bcb-48bc-b531-f701df9c3935 req-de4dfc3b-eac8-4f93-b75f-c26cf9272e12 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Refreshing network info cache for port cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Start _get_guest_xml network_info=[{"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:11:11 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:11 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1413169235',display_name='tempest-tempest.common.compute-instance-1413169235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1413169235',id=32,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdIoqmkvBna6Fv6ppa7qEeS6l1KBSr/ZyBTQ7THMwZctuzylt05K45+gXmZE4p1MmHrojrazd4igdKhE8hysq24F9wXqR6aGP7N8BCzHsubCBOyMJOIqKdYEs5cpfbyHw==',key_name='tempest-keypair-781582706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-oykyumb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=97925529-42d3-45de-af1b-be5df85c70e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'pci_devices' on Instance uuid 97925529-42d3-45de-af1b-be5df85c70e3 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:11:11 user nova-compute[74959]:   <uuid>97925529-42d3-45de-af1b-be5df85c70e3</uuid>
Nov 28 23:11:11 user nova-compute[74959]:   <name>instance-00000020</name>
Nov 28 23:11:11 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:11:11 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:11:11 user nova-compute[74959]:   <metadata>
Nov 28 23:11:11 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:11:11 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:11:11 user nova-compute[74959]:       <nova:name>tempest-tempest.common.compute-instance-1413169235</nova:name>
Nov 28 23:11:11 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:11:11</nova:creationTime>
Nov 28 23:11:11 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:11:11 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:11:11 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:11:11 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:11:11 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:11:11 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:11:11 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:11:11 user nova-compute[74959]:       <nova:owner>
Nov 28 23:11:11 user nova-compute[74959]:         <nova:user uuid="73af90e11a374c9cbf0a58db8410e245">tempest-ServerActionsTestOtherA-2143945835-project-member</nova:user>
Nov 28 23:11:11 user nova-compute[74959]:         <nova:project uuid="0ac0d1f399f040f98098e84ac875c1fd">tempest-ServerActionsTestOtherA-2143945835</nova:project>
Nov 28 23:11:11 user nova-compute[74959]:       </nova:owner>
Nov 28 23:11:11 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:11:11 user nova-compute[74959]:       <nova:ports>
Nov 28 23:11:11 user nova-compute[74959]:         <nova:port uuid="cfe2d164-f283-4339-a4ea-8732b732ce64">
Nov 28 23:11:11 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:11:11 user nova-compute[74959]:         </nova:port>
Nov 28 23:11:11 user nova-compute[74959]:       </nova:ports>
Nov 28 23:11:11 user nova-compute[74959]:     </nova:instance>
Nov 28 23:11:11 user nova-compute[74959]:   </metadata>
Nov 28 23:11:11 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:11:11 user nova-compute[74959]:     <system>
Nov 28 23:11:11 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:11:11 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:11:11 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:11:11 user nova-compute[74959]:       <entry name="serial">97925529-42d3-45de-af1b-be5df85c70e3</entry>
Nov 28 23:11:11 user nova-compute[74959]:       <entry name="uuid">97925529-42d3-45de-af1b-be5df85c70e3</entry>
Nov 28 23:11:11 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:11:11 user nova-compute[74959]:     </system>
Nov 28 23:11:11 user nova-compute[74959]:   </sysinfo>
Nov 28 23:11:11 user nova-compute[74959]:   <os>
Nov 28 23:11:11 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:11:11 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:11:11 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:11:11 user nova-compute[74959]:   </os>
Nov 28 23:11:11 user nova-compute[74959]:   <features>
Nov 28 23:11:11 user nova-compute[74959]:     <acpi/>
Nov 28 23:11:11 user nova-compute[74959]:     <apic/>
Nov 28 23:11:11 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:11:11 user nova-compute[74959]:   </features>
Nov 28 23:11:11 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:11:11 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:11:11 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:11:11 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:11:11 user nova-compute[74959]:   </clock>
Nov 28 23:11:11 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:11:11 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:11:11 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:11:11 user nova-compute[74959]:   </cpu>
Nov 28 23:11:11 user nova-compute[74959]:   <devices>
Nov 28 23:11:11 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:11:11 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:11:11 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk"/>
Nov 28 23:11:11 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:11:11 user nova-compute[74959]:     </disk>
Nov 28 23:11:11 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:11:11 user nova-compute[74959]:       <mac address="fa:16:3e:49:d5:64"/>
Nov 28 23:11:11 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:11:11 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:11:11 user nova-compute[74959]:       <target dev="tapcfe2d164-f2"/>
Nov 28 23:11:11 user nova-compute[74959]:     </interface>
Nov 28 23:11:11 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:11:11 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/console.log" append="off"/>
Nov 28 23:11:11 user nova-compute[74959]:     </serial>
Nov 28 23:11:11 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:11:11 user nova-compute[74959]:     <video>
Nov 28 23:11:11 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:11:11 user nova-compute[74959]:     </video>
Nov 28 23:11:11 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:11:11 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:11:11 user nova-compute[74959]:     </rng>
Nov 28 23:11:11 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:11:11 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:11:11 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:11:11 user nova-compute[74959]:     </memballoon>
Nov 28 23:11:11 user nova-compute[74959]:   </devices>
Nov 28 23:11:11 user nova-compute[74959]: </domain>
Nov 28 23:11:11 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1413169235',display_name='tempest-tempest.common.compute-instance-1413169235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1413169235',id=32,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdIoqmkvBna6Fv6ppa7qEeS6l1KBSr/ZyBTQ7THMwZctuzylt05K45+gXmZE4p1MmHrojrazd4igdKhE8hysq24F9wXqR6aGP7N8BCzHsubCBOyMJOIqKdYEs5cpfbyHw==',key_name='tempest-keypair-781582706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-oykyumb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=97925529-42d3-45de-af1b-be5df85c70e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG os_vif [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3947396c-62eb-5929-ab65-dddbc00a0875', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfe2d164-f2, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfe2d164-f2, col_values=(('qos', UUID('e206ee43-c3d5-4b11-b262-e670d1236280')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfe2d164-f2, col_values=(('external_ids', {'iface-id': 'cfe2d164-f283-4339-a4ea-8732b732ce64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:d5:64', 'vm-uuid': '97925529-42d3-45de-af1b-be5df85c70e3'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:11 user nova-compute[74959]: INFO os_vif [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2')
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No VIF found with MAC fa:16:3e:49:d5:64, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.network.neutron [req-b7fdb36f-3bcb-48bc-b531-f701df9c3935 req-de4dfc3b-eac8-4f93-b75f-c26cf9272e12 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updated VIF entry in instance network info cache for port cfe2d164-f283-4339-a4ea-8732b732ce64. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG nova.network.neutron [req-b7fdb36f-3bcb-48bc-b531-f701df9c3935 req-de4dfc3b-eac8-4f93-b75f-c26cf9272e12 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updating instance_info_cache with network_info: [{"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b7fdb36f-3bcb-48bc-b531-f701df9c3935 req-de4dfc3b-eac8-4f93-b75f-c26cf9272e12 service nova] Releasing lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG os_brick.utils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7131003-71c6-43e3-bf1a-6be3f5b8f9f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c485676-2d0c-4930-9fb8-b5e7cdaa77c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecbda31-1781-438c-a95f-2dacab3629be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[df12b67a-dade-44e8-85b9-089196fd6d17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:12 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef601564-a7a9-4c37-b975-37fad40e0ec0]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG os_brick.utils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Updating existing volume attachment record: 60e76f81-4b9c-42d5-aff2-c2d346464332 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-e0cc4ce1-6f93-4886-84ff-871f4457594b req-b4aa0b31-a18d-4ea9-b607-bbf26bbbd5f6 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e0cc4ce1-6f93-4886-84ff-871f4457594b req-b4aa0b31-a18d-4ea9-b607-bbf26bbbd5f6 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e0cc4ce1-6f93-4886-84ff-871f4457594b req-b4aa0b31-a18d-4ea9-b607-bbf26bbbd5f6 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e0cc4ce1-6f93-4886-84ff-871f4457594b req-b4aa0b31-a18d-4ea9-b607-bbf26bbbd5f6 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-e0cc4ce1-6f93-4886-84ff-871f4457594b req-b4aa0b31-a18d-4ea9-b607-bbf26bbbd5f6 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:12 user nova-compute[74959]: WARNING nova.compute.manager [req-e0cc4ce1-6f93-4886-84ff-871f4457594b req-b4aa0b31-a18d-4ea9-b607-bbf26bbbd5f6 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state building and task_state spawning.
Nov 28 23:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:11:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance spawned successfully.
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:14 user nova-compute[74959]: INFO nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-46a5c66a-c03c-4b7b-b4e8-b19a362236ce req-f9b3b57d-db28-4aa3-b4f8-b630a45081be service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-46a5c66a-c03c-4b7b-b4e8-b19a362236ce req-f9b3b57d-db28-4aa3-b4f8-b630a45081be service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-46a5c66a-c03c-4b7b-b4e8-b19a362236ce req-f9b3b57d-db28-4aa3-b4f8-b630a45081be service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-46a5c66a-c03c-4b7b-b4e8-b19a362236ce req-f9b3b57d-db28-4aa3-b4f8-b630a45081be service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-46a5c66a-c03c-4b7b-b4e8-b19a362236ce req-f9b3b57d-db28-4aa3-b4f8-b630a45081be service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:14 user nova-compute[74959]: WARNING nova.compute.manager [req-46a5c66a-c03c-4b7b-b4e8-b19a362236ce req-f9b3b57d-db28-4aa3-b4f8-b630a45081be service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state building and task_state spawning.
Nov 28 23:11:15 user nova-compute[74959]: INFO nova.compute.manager [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Took 6.56 seconds to build instance.
Nov 28 23:11:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2a75f8a0-4905-4598-8bd8-f0d880ee37dc tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.669s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-b8ad4df2-1da4-479b-9016-f4623ce57915 req-db83f623-50c4-4389-9a7d-2cc5ea4eb3a0 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received event network-changed-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-b8ad4df2-1da4-479b-9016-f4623ce57915 req-db83f623-50c4-4389-9a7d-2cc5ea4eb3a0 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Refreshing instance network info cache due to event network-changed-db47062d-08bc-466e-9e85-472b2c58f9c5. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:11:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b8ad4df2-1da4-479b-9016-f4623ce57915 req-db83f623-50c4-4389-9a7d-2cc5ea4eb3a0 service nova] Acquiring lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b8ad4df2-1da4-479b-9016-f4623ce57915 req-db83f623-50c4-4389-9a7d-2cc5ea4eb3a0 service nova] Acquired lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:19 user nova-compute[74959]: DEBUG nova.network.neutron [req-b8ad4df2-1da4-479b-9016-f4623ce57915 req-db83f623-50c4-4389-9a7d-2cc5ea4eb3a0 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Refreshing network info cache for port db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.network.neutron [req-b8ad4df2-1da4-479b-9016-f4623ce57915 req-db83f623-50c4-4389-9a7d-2cc5ea4eb3a0 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Updated VIF entry in instance network info cache for port db47062d-08bc-466e-9e85-472b2c58f9c5. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.network.neutron [req-b8ad4df2-1da4-479b-9016-f4623ce57915 req-db83f623-50c4-4389-9a7d-2cc5ea4eb3a0 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Updating instance_info_cache with network_info: [{"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b8ad4df2-1da4-479b-9016-f4623ce57915 req-db83f623-50c4-4389-9a7d-2cc5ea4eb3a0 service nova] Releasing lock "refresh_cache-d0c359b5-f676-47a2-9e6e-e83e1813206b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:11:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Creating image(s)
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Ensure instance console log exists: /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Start _get_guest_xml network_info=[{"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiZhgvEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16ec5cae-3d8c-427b-a117-e0b8be34be5f', 'attached_at': '', 'detached_at': '', 'volume_id': '584501bf-b59a-43fd-ab2a-5dddfb514f49', 'serial': '584501bf-b59a-43fd-ab2a-5dddfb514f49'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '60e76f81-4b9c-42d5-aff2-c2d346464332', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:11:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiZhgvEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:20 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:20 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:20 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d57f7e-2b62-41ac-834a-575820e502ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:11:20 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd675b3b-cd3f-4f6a-af66-f8e0b573a2ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49] added
Nov 28 23:11:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cdbe1e-40ea-4f37-8ef8-65eaa500dc84]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[100b4c80-b88b-43a6-99a8-5932825203f3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiZhgvEl {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiZhgvEl" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb2d387-0764-470b-b09b-f84434593d55]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NiZhgvEl'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[785a60e7-ae15-49f8-b068-16dd85bfe1ab]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4844350d-1c9f-4121-b514-6542a3903f84]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:20 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:20 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1475b393-7643-423a-8de9-47c8844abaf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49, portal: 172.16.0.220,3260]
Nov 28 23:11:20 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49, portal: 172.16.0.220,3260] successful.
Nov 28 23:11:20 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadec923-39bf-4126-b7df-ab21ed89dc5f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:20 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c997ee7-4457-4fe2-9402-94b95907284e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:21 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:21 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:21 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:21 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:21 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:21 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb77313a-6335-4752-9c60-8b8ca9923672]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiZhgvEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23663646362626164', 'path': '/dev/sdd'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663646362626164', 'path': '/dev/sdd'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:11:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-246858674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-246858674',id=31,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-90m40xs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:11:06Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=16ec5cae-3d8c-427b-a117-e0b8be34be5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:32:08,bridge_name='br-int',has_traffic_filtering=True,id=47fc4ac0-57b6-463f-b77d-daa68b8abdeb,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc4ac0-57') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'pci_devices' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:11:22 user nova-compute[74959]:   <uuid>16ec5cae-3d8c-427b-a117-e0b8be34be5f</uuid>
Nov 28 23:11:22 user nova-compute[74959]:   <name>instance-0000001f</name>
Nov 28 23:11:22 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:11:22 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:11:22 user nova-compute[74959]:   <metadata>
Nov 28 23:11:22 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:11:22 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:11:22 user nova-compute[74959]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-246858674</nova:name>
Nov 28 23:11:22 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:11:20</nova:creationTime>
Nov 28 23:11:22 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:11:22 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:11:22 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:11:22 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:11:22 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:11:22 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:11:22 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:11:22 user nova-compute[74959]:       <nova:owner>
Nov 28 23:11:22 user nova-compute[74959]:         <nova:user uuid="5a8d218abbe14f27b754f1fffd9553f8">tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member</nova:user>
Nov 28 23:11:22 user nova-compute[74959]:         <nova:project uuid="8da22f0050e34c9b9a7658f16c08f28b">tempest-ServerBootFromVolumeStableRescueTest-1156029205</nova:project>
Nov 28 23:11:22 user nova-compute[74959]:       </nova:owner>
Nov 28 23:11:22 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:11:22 user nova-compute[74959]:       <nova:ports>
Nov 28 23:11:22 user nova-compute[74959]:         <nova:port uuid="47fc4ac0-57b6-463f-b77d-daa68b8abdeb">
Nov 28 23:11:22 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 23:11:22 user nova-compute[74959]:         </nova:port>
Nov 28 23:11:22 user nova-compute[74959]:       </nova:ports>
Nov 28 23:11:22 user nova-compute[74959]:     </nova:instance>
Nov 28 23:11:22 user nova-compute[74959]:   </metadata>
Nov 28 23:11:22 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:11:22 user nova-compute[74959]:     <system>
Nov 28 23:11:22 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:11:22 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:11:22 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:11:22 user nova-compute[74959]:       <entry name="serial">16ec5cae-3d8c-427b-a117-e0b8be34be5f</entry>
Nov 28 23:11:22 user nova-compute[74959]:       <entry name="uuid">16ec5cae-3d8c-427b-a117-e0b8be34be5f</entry>
Nov 28 23:11:22 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:11:22 user nova-compute[74959]:     </system>
Nov 28 23:11:22 user nova-compute[74959]:   </sysinfo>
Nov 28 23:11:22 user nova-compute[74959]:   <os>
Nov 28 23:11:22 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:11:22 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:11:22 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:11:22 user nova-compute[74959]:   </os>
Nov 28 23:11:22 user nova-compute[74959]:   <features>
Nov 28 23:11:22 user nova-compute[74959]:     <acpi/>
Nov 28 23:11:22 user nova-compute[74959]:     <apic/>
Nov 28 23:11:22 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:11:22 user nova-compute[74959]:   </features>
Nov 28 23:11:22 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:11:22 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:11:22 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:11:22 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:11:22 user nova-compute[74959]:   </clock>
Nov 28 23:11:22 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:11:22 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:11:22 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:11:22 user nova-compute[74959]:   </cpu>
Nov 28 23:11:22 user nova-compute[74959]:   <devices>
Nov 28 23:11:22 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:11:22 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:11:22 user nova-compute[74959]:       <source dev="/dev/sdd"/>
Nov 28 23:11:22 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:11:22 user nova-compute[74959]:       <serial>584501bf-b59a-43fd-ab2a-5dddfb514f49</serial>
Nov 28 23:11:22 user nova-compute[74959]:     </disk>
Nov 28 23:11:22 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:11:22 user nova-compute[74959]:       <mac address="fa:16:3e:66:32:08"/>
Nov 28 23:11:22 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:11:22 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:11:22 user nova-compute[74959]:       <target dev="tap47fc4ac0-57"/>
Nov 28 23:11:22 user nova-compute[74959]:     </interface>
Nov 28 23:11:22 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:11:22 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/console.log" append="off"/>
Nov 28 23:11:22 user nova-compute[74959]:     </serial>
Nov 28 23:11:22 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:11:22 user nova-compute[74959]:     <video>
Nov 28 23:11:22 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:11:22 user nova-compute[74959]:     </video>
Nov 28 23:11:22 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:11:22 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:11:22 user nova-compute[74959]:     </rng>
Nov 28 23:11:22 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:11:22 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:11:22 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:11:22 user nova-compute[74959]:     </memballoon>
Nov 28 23:11:22 user nova-compute[74959]:   </devices>
Nov 28 23:11:22 user nova-compute[74959]: </domain>
Nov 28 23:11:22 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:11:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-246858674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-246858674',id=31,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-90m40xs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:11:06Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=16ec5cae-3d8c-427b-a117-e0b8be34be5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:32:08,bridge_name='br-int',has_traffic_filtering=True,id=47fc4ac0-57b6-463f-b77d-daa68b8abdeb,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc4ac0-57') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG os_vif [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:32:08,bridge_name='br-int',has_traffic_filtering=True,id=47fc4ac0-57b6-463f-b77d-daa68b8abdeb,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc4ac0-57') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8069cd7-45bb-5aaa-81fa-40b96e441392', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47fc4ac0-57, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47fc4ac0-57, col_values=(('qos', UUID('4e5d0045-3887-4d32-be2d-653f63249477')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47fc4ac0-57, col_values=(('external_ids', {'iface-id': '47fc4ac0-57b6-463f-b77d-daa68b8abdeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:32:08', 'vm-uuid': '16ec5cae-3d8c-427b-a117-e0b8be34be5f'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:22 user nova-compute[74959]: INFO os_vif [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:32:08,bridge_name='br-int',has_traffic_filtering=True,id=47fc4ac0-57b6-463f-b77d-daa68b8abdeb,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc4ac0-57')
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No VIF found with MAC fa:16:3e:66:32:08, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG nova.objects.instance [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid d0c359b5-f676-47a2-9e6e-e83e1813206b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:22 user nova-compute[74959]: INFO nova.compute.manager [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Attaching volume 2e448683-5845-4298-ada0-a4220ddc298a to /dev/vdb
Nov 28 23:11:23 user nova-compute[74959]: DEBUG os_brick.utils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd523a26-45b0-4a80-b6c7-a6e89bbc8b6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5739669a-50ea-4260-a48c-cd6831d8f190]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd347406-b5de-41fb-ba6a-92623c0feb67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ddb9d4-587e-4a31-83a2-a4aeba8a93f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:23 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8a8e4e-6dec-47df-b84e-7995f14993b8]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG os_brick.utils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Updating existing volume attachment record: 16b27079-9222-4e16-b0f0-d9f110366701 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-61d329b9-03dd-480d-9e89-0590ea209934 req-3068b955-c15c-467d-8a05-0c153bec81dd service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-61d329b9-03dd-480d-9e89-0590ea209934 req-3068b955-c15c-467d-8a05-0c153bec81dd service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-61d329b9-03dd-480d-9e89-0590ea209934 req-3068b955-c15c-467d-8a05-0c153bec81dd service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-61d329b9-03dd-480d-9e89-0590ea209934 req-3068b955-c15c-467d-8a05-0c153bec81dd service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-61d329b9-03dd-480d-9e89-0590ea209934 req-3068b955-c15c-467d-8a05-0c153bec81dd service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:23 user nova-compute[74959]: WARNING nova.compute.manager [req-61d329b9-03dd-480d-9e89-0590ea209934 req-3068b955-c15c-467d-8a05-0c153bec81dd service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state building and task_state spawning.
Nov 28 23:11:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:11:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance spawned successfully.
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-6591950e-3993-4f1c-85e0-4a0518a74d57 req-80258bf5-ef08-4c64-b083-0d57233f3446 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6591950e-3993-4f1c-85e0-4a0518a74d57 req-80258bf5-ef08-4c64-b083-0d57233f3446 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6591950e-3993-4f1c-85e0-4a0518a74d57 req-80258bf5-ef08-4c64-b083-0d57233f3446 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6591950e-3993-4f1c-85e0-4a0518a74d57 req-80258bf5-ef08-4c64-b083-0d57233f3446 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-6591950e-3993-4f1c-85e0-4a0518a74d57 req-80258bf5-ef08-4c64-b083-0d57233f3446 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:25 user nova-compute[74959]: WARNING nova.compute.manager [req-6591950e-3993-4f1c-85e0-4a0518a74d57 req-80258bf5-ef08-4c64-b083-0d57233f3446 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state building and task_state spawning.
Nov 28 23:11:25 user nova-compute[74959]: INFO nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 28 23:11:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:11:25 user nova-compute[74959]: INFO nova.compute.manager [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Took 20.15 seconds to build instance.
Nov 28 23:11:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9cc7ae4-37d4-423b-ae81-893625d910a6 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.251s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG nova.objects.instance [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'flavor' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:30 user nova-compute[74959]: INFO nova.compute.manager [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Attaching volume 652ac64f-6454-4b76-b7de-19b2d70f4802 to /dev/vdb
Nov 28 23:11:30 user nova-compute[74959]: DEBUG os_brick.utils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab92297-be6e-4094-8331-d1d11b64ed31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d345a6ce-fc42-4298-bc43-cf8a3bd38312]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3703202d-336e-4f77-af10-48d2a69bc12e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43f2201-602f-4c4f-aaf8-ccc88a33ea6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:30 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:11:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf37d668-0706-425c-b3cd-bde7932c5e74]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG os_brick.utils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:30 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating existing volume attachment record: dbd7f792-94e0-490e-b18b-c4eab21e2b11 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeLRmOxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:31 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:31 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:31 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4154e422-c34e-4e09-a77c-988cc1b4520b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:11:31 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[272ccdf0-9ce7-4454-afd6-e0a0c6eaa6eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a] added
Nov 28 23:11:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a284fecc-7a60-402f-acd9-cdb9b1039cc1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d744d4-afb4-4aa7-9e26-a03923692944]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DeLRmOxA {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DeLRmOxA" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afbc319-c4e3-4d2d-989a-3d3c20634ab8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DeLRmOxA'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5152f02b-078f-4798-9636-fba63e74ccbd]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbe25b2-efef-4380-8950-c8ab3d7f7526]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8436480-c10e-4297-b046-3ee84425b5a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a, portal: 172.16.0.220,3260]
Nov 28 23:11:31 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a, portal: 172.16.0.220,3260] successful.
Nov 28 23:11:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4bbb88-fe9c-43a1-a397-3551bcf5d346]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e686e-102e-4cee-90f0-991fb1d3a1f6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:31 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[781c9116-40c9-4a0c-b1a2-9064bfa6c516]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:11:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:32 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:11:32 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeLRmOxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:11:32 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:32 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26633316132336136', 'path': '/dev/sde'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633316132336136', 'path': '/dev/sde'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:11:32 user nova-compute[74959]: DEBUG nova.objects.instance [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid d0c359b5-f676-47a2-9e6e-e83e1813206b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:11:32 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:11:32 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:11:32 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:11:32 user nova-compute[74959]:   <serial>2e448683-5845-4298-ada0-a4220ddc298a</serial>
Nov 28 23:11:32 user nova-compute[74959]: </disk>
Nov 28 23:11:32 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:11:33 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:33 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:33 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] No VIF found with MAC fa:16:3e:ef:52:ac, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:11:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-7b6ed96f-f202-45ef-bd2f-a6f0c904afa5 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.393s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:34 user nova-compute[74959]: INFO nova.compute.manager [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Detaching volume 2e448683-5845-4298-ada0-a4220ddc298a
Nov 28 23:11:34 user nova-compute[74959]: INFO nova.virt.block_device [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Attempting to driver detach volume 2e448683-5845-4298-ada0-a4220ddc298a from mountpoint /dev/vdb
Nov 28 23:11:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Attempting to detach device vdb from instance d0c359b5-f676-47a2-9e6e-e83e1813206b from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:11:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:11:34 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:11:34 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:11:34 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:11:34 user nova-compute[74959]:   <serial>2e448683-5845-4298-ada0-a4220ddc298a</serial>
Nov 28 23:11:34 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:11:34 user nova-compute[74959]: </disk>
Nov 28 23:11:34 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:11:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully detached device vdb from instance d0c359b5-f676-47a2-9e6e-e83e1813206b from the persistent domain config.
Nov 28 23:11:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0c359b5-f676-47a2-9e6e-e83e1813206b from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:11:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:11:34 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:11:34 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:11:34 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:11:34 user nova-compute[74959]:   <serial>2e448683-5845-4298-ada0-a4220ddc298a</serial>
Nov 28 23:11:34 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:11:34 user nova-compute[74959]: </disk>
Nov 28 23:11:34 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:11:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0c359b5-f676-47a2-9e6e-e83e1813206b {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:11:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-21b140f7-c958-4544-912e-321c98ee04f4 req-7fa973b3-dd59-48d7-ab54-fb82f9e75d78 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received event network-changed-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-21b140f7-c958-4544-912e-321c98ee04f4 req-7fa973b3-dd59-48d7-ab54-fb82f9e75d78 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Refreshing instance network info cache due to event network-changed-27d08f4d-04eb-4dcd-ab2f-a5f730917f09. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:11:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21b140f7-c958-4544-912e-321c98ee04f4 req-7fa973b3-dd59-48d7-ab54-fb82f9e75d78 service nova] Acquiring lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21b140f7-c958-4544-912e-321c98ee04f4 req-7fa973b3-dd59-48d7-ab54-fb82f9e75d78 service nova] Acquired lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:35 user nova-compute[74959]: DEBUG nova.network.neutron [req-21b140f7-c958-4544-912e-321c98ee04f4 req-7fa973b3-dd59-48d7-ab54-fb82f9e75d78 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Refreshing network info cache for port 27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:11:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-21b140f7-c958-4544-912e-321c98ee04f4 req-7fa973b3-dd59-48d7-ab54-fb82f9e75d78 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Updated VIF entry in instance network info cache for port 27d08f4d-04eb-4dcd-ab2f-a5f730917f09. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:11:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-21b140f7-c958-4544-912e-321c98ee04f4 req-7fa973b3-dd59-48d7-ab54-fb82f9e75d78 service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Updating instance_info_cache with network_info: [{"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21b140f7-c958-4544-912e-321c98ee04f4 req-7fa973b3-dd59-48d7-ab54-fb82f9e75d78 service nova] Releasing lock "refresh_cache-dc9885ed-08ef-484c-89f6-97e4320217bc" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUvkWiXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:38 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:38 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:38 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:38 user nova-compute[74959]: INFO nova.compute.manager [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Attaching volume c90d5c53-f147-4f50-a561-8a791776f2fd to /dev/vdb
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcaa019-78ec-403d-b972-924a9ffdfd54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:11:38 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fd288a-ee79-44e2-9da1-baea167ef8dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802] added
Nov 28 23:11:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c52e15-a567-4dab-b008-3f6c35345148]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4498fa7a-586f-459b-a26a-573911ceaf98]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUvkWiXx {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.utils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUvkWiXx" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2abf1a-45c4-4cfb-b3ae-4bf30e598c28]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUvkWiXx'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.040s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[64215307-afba-4378-bd13-ba133357ec1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c65cb8-9a55-4e84-922c-9381cb066a44]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10a5fb3-f1ae-48f1-975e-1a9254508874]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827ebd6-6d3e-4e52-92f9-3726ea73ab9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d27d073-d646-4f50-992f-fb7a2f86ef96]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:38 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:38 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:38 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:38 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:38 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:38 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[910703e9-c61c-4c01-9bc1-682af587954d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:38 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e8eb2-80a0-4478-8fb2-e43703cb0123]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.utils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Updating existing volume attachment record: 4c22c664-8ee0-458e-9727-46ba1c11e666 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7cd263-dd0b-45eb-9d40-66ff8bf34946]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260]
Nov 28 23:11:38 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260] successful.
Nov 28 23:11:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5794ac-0eb4-4538-b6ed-7fbbba078d24]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa5e446-08dd-4a81-b690-e070bc0f6886]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:39 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:39 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:39 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:39 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:39 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:39 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:39 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:39 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab8ba01-a95d-44a0-ba8d-38e60c0a4dc0]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:11:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUvkWiXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26131636464316531', 'path': '/dev/sdf'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131636464316531', 'path': '/dev/sdf'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG nova.objects.instance [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'flavor' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:11:40 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:11:40 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:11:40 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:11:40 user nova-compute[74959]:   <serial>652ac64f-6454-4b76-b7de-19b2d70f4802</serial>
Nov 28 23:11:40 user nova-compute[74959]: </disk>
Nov 28 23:11:40 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No VIF found with MAC fa:16:3e:20:45:49, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c9386a0-9df2-47bd-8298-c3014a89e5cb tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.924s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:40 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:11:41 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [{"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-f180b6b0-ff56-4d28-9a5d-06244e04c1f5" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:11:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWNGqovn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:46 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:46 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:46 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93550fa-fd1f-4b69-9fdf-80fbde474e83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:11:46 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2581f1cc-b155-46a1-93ba-176f5b79b15b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd] added
Nov 28 23:11:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ed4fa4-3e6e-4a6f-bf35-4326b0ada8ed]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bf9c65-6245-428e-a2bd-dcc692e6ba17]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AWNGqovn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AWNGqovn" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc29165-026a-41f1-850d-3534330c99b5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AWNGqovn'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec71dbb-fc6a-42be-9cad-ceabceca5cd6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[966bf670-3421-49be-bb9f-3d43416c4093]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1fee72-2f69-4596-860c-5c64fcebcf45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd, portal: 172.16.0.220,3260]
Nov 28 23:11:46 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd, portal: 172.16.0.220,3260] successful.
Nov 28 23:11:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3122b77-7cdb-41e1-87ae-ec3ccf4af952]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[191546ff-caf2-4b51-8840-06185de2ace1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:46 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1ac615-7743-49cf-a6d8-36cbc6dd324a]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWNGqovn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-277f8fcd-47b5-40f4-9c30-848c2e996f3b req-223fac83-d1a6-4bb5-bb32-dd872afea774 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-277f8fcd-47b5-40f4-9c30-848c2e996f3b req-223fac83-d1a6-4bb5-bb32-dd872afea774 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing instance network info cache due to event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-277f8fcd-47b5-40f4-9c30-848c2e996f3b req-223fac83-d1a6-4bb5-bb32-dd872afea774 service nova] Acquiring lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-277f8fcd-47b5-40f4-9c30-848c2e996f3b req-223fac83-d1a6-4bb5-bb32-dd872afea774 service nova] Acquired lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG nova.network.neutron [req-277f8fcd-47b5-40f4-9c30-848c2e996f3b req-223fac83-d1a6-4bb5-bb32-dd872afea774 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23864656633396264', 'path': '/dev/sdg'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864656633396264', 'path': '/dev/sdg'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:11:47 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:11:47 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:11:47 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:11:47 user nova-compute[74959]:   <serial>c90d5c53-f147-4f50-a561-8a791776f2fd</serial>
Nov 28 23:11:47 user nova-compute[74959]: </disk>
Nov 28 23:11:47 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-277f8fcd-47b5-40f4-9c30-848c2e996f3b req-223fac83-d1a6-4bb5-bb32-dd872afea774 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updated VIF entry in instance network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-277f8fcd-47b5-40f4-9c30-848c2e996f3b req-223fac83-d1a6-4bb5-bb32-dd872afea774 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-277f8fcd-47b5-40f4-9c30-848c2e996f3b req-223fac83-d1a6-4bb5-bb32-dd872afea774 service nova] Releasing lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No VIF found with MAC fa:16:3e:05:e6:2a, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b16d9170-34af-428e-bd41-7b6498cbc1e4 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.944s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-001ddf34-ce82-47d1-bd19-3b200d5cc0be req-da436835-9ffe-4308-b8d3-7804cf1610d5 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-001ddf34-ce82-47d1-bd19-3b200d5cc0be req-da436835-9ffe-4308-b8d3-7804cf1610d5 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing instance network info cache due to event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-001ddf34-ce82-47d1-bd19-3b200d5cc0be req-da436835-9ffe-4308-b8d3-7804cf1610d5 service nova] Acquiring lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-001ddf34-ce82-47d1-bd19-3b200d5cc0be req-da436835-9ffe-4308-b8d3-7804cf1610d5 service nova] Acquired lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG nova.network.neutron [req-001ddf34-ce82-47d1-bd19-3b200d5cc0be req-da436835-9ffe-4308-b8d3-7804cf1610d5 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:11:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG nova.network.neutron [req-001ddf34-ce82-47d1-bd19-3b200d5cc0be req-da436835-9ffe-4308-b8d3-7804cf1610d5 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updated VIF entry in instance network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG nova.network.neutron [req-001ddf34-ce82-47d1-bd19-3b200d5cc0be req-da436835-9ffe-4308-b8d3-7804cf1610d5 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-001ddf34-ce82-47d1-bd19-3b200d5cc0be req-da436835-9ffe-4308-b8d3-7804cf1610d5 service nova] Releasing lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:51 user nova-compute[74959]: INFO nova.compute.manager [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Terminating instance
Nov 28 23:11:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-unplugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] No waiting events found dispatching network-vif-unplugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-unplugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] Acquiring lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] No waiting events found dispatching network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:52 user nova-compute[74959]: WARNING nova.compute.manager [req-826a6b81-d65f-42cc-88da-6f6f5def6972 req-a03d05b4-08c5-4f6b-82b4-7f662e6d44ab service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received unexpected event network-vif-plugged-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f for instance with vm_state active and task_state deleting.
Nov 28 23:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:52 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:52 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7046MB free_disk=24.95233154296875GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Instance destroyed successfully.
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.objects.instance [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lazy-loading 'resources' on Instance uuid f180b6b0-ff56-4d28-9a5d-06244e04c1f5 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1977703593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1977703593',id=23,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkxFFQQKBAfO/SApxPbwX9zAeEyNRaEAPAtbyW3Oh1BR8HoVfkbWwsOsLh2Q+1UuVyy640UwC+mHWtb8lnf6GLZY7z1dyYQrviUMet94Y7CLHS0p/0tiqszkHln2EXlA==',key_name='tempest-keypair-488060459',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:10:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef225be98f448b69f250a21c002c237',ramdisk_id='',reservation_id='r-gphxhirs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-533572635',owner_user_name='tempest-AttachVolumeShelveTestJSON-533572635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecd0185bcfae4e058dade500ad82dbd2',uuid=f180b6b0-ff56-4d28-9a5d-06244e04c1f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converting VIF {"id": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "address": "fa:16:3e:56:0c:e2", "network": {"id": "b9a0b63d-d6a6-40f6-b29a-3a586fd4172c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1606731810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef225be98f448b69f250a21c002c237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6d4f6a-61", "ovs_interfaceid": "fe6d4f6a-611a-4d09-abcc-053f06cb6e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG os_vif [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe6d4f6a-61, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ead01097-679f-45db-ad4f-3249bef9289c) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:52 user nova-compute[74959]: INFO os_vif [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:0c:e2,bridge_name='br-int',has_traffic_filtering=True,id=fe6d4f6a-611a-4d09-abcc-053f06cb6e4f,network=Network(b9a0b63d-d6a6-40f6-b29a-3a586fd4172c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6d4f6a-61')
Nov 28 23:11:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Deleting instance files /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5_del
Nov 28 23:11:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Deletion of /opt/stack/data/nova/instances/f180b6b0-ff56-4d28-9a5d-06244e04c1f5_del complete
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:52 user nova-compute[74959]: INFO nova.compute.manager [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d0c359b5-f676-47a2-9e6e-e83e1813206b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance dc9885ed-08ef-484c-89f6-97e4320217bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance f180b6b0-ff56-4d28-9a5d-06244e04c1f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 0bf7ba2c-355f-4ee4-8937-ad80724df48f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 16ec5cae-3d8c-427b-a117-e0b8be34be5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 97925529-42d3-45de-af1b-be5df85c70e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:52 user nova-compute[74959]: INFO nova.compute.manager [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Attaching volume 04141115-4e87-4d4f-ae83-4df279f41f9b to /dev/vdc
Nov 28 23:11:52 user nova-compute[74959]: DEBUG os_brick.utils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c9f95-09b9-4bf6-b9da-c1dab4b5cbde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74ca365-a0ce-4bcc-b372-64a6d03a9543]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bd8d1f-c62f-4646-a644-da1f96c3c392]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cc869e-8541-4ad8-b4b0-202ca0447105]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:11:52 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8939afb-afb8-4af9-a5a4-3db8d9fd1d57]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG os_brick.utils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Updating existing volume attachment record: adf99da3-1e58-4700-be1a-b2097b17dc0d {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.773s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:53 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:53 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Took 0.87 seconds to deallocate network for instance.
Nov 28 23:11:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:53 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:11:53 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:11:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:53 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Deleted allocations for instance f180b6b0-ff56-4d28-9a5d-06244e04c1f5
Nov 28 23:11:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5541d5af-9243-44d6-9ff8-4ea8d9255cb8 tempest-AttachVolumeShelveTestJSON-533572635 tempest-AttachVolumeShelveTestJSON-533572635-project-member] Lock "f180b6b0-ff56-4d28-9a5d-06244e04c1f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.643s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-fd57f642-546f-4a0c-a7ce-d8be2d939d48 req-672c53c4-5877-4e7e-899d-918d384ce895 service nova] [instance: f180b6b0-ff56-4d28-9a5d-06244e04c1f5] Received event network-vif-deleted-fe6d4f6a-611a-4d09-abcc-053f06cb6e4f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:54 user nova-compute[74959]: INFO nova.compute.manager [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Rebooting instance
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquired lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Releasing lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:54 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d0c359b5-f676-47a2-9e6e-e83e1813206b is timed out.
Nov 28 23:11:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully detached device vdb from instance d0c359b5-f676-47a2-9e6e-e83e1813206b from the live domain config.
Nov 28 23:11:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeLRmOxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:54 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[012168f1-aef5-442c-93f6-2f5000104544]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:11:54 user nova-compute[74959]: No targets found.
Nov 28 23:11:54 user nova-compute[74959]: iSNS:
Nov 28 23:11:54 user nova-compute[74959]: No targets found.
Nov 28 23:11:54 user nova-compute[74959]: STATIC:
Nov 28 23:11:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:11:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:11:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a
Nov 28 23:11:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:11:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:11:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd
Nov 28 23:11:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:54 user nova-compute[74959]: FIRMWARE:
Nov 28 23:11:54 user nova-compute[74959]: No targets found.
Nov 28 23:11:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:11:54 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:11:54 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6406cf12-94e8-4fa9-85be-331ab749c911]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fb7c8f-87dc-4c0c-ae8e-18ac141cfa33]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:54 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc798160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a'): ({'sde'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Removing single pathed devices sde {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c853b37-3083-438b-8b90-03669a483781]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba27a377-f297-4c7f-9f93-53fda23d5808]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Flushing IO for device /dev/sde {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0529d-3a69-47a8-8109-0549d84f8d9c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-e6c8932d-5085-4bc6-950d-3e4260551a0e req-5a1aac59-1641-49a0-a5d2-1c1fb25793f1 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-unplugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e6c8932d-5085-4bc6-950d-3e4260551a0e req-5a1aac59-1641-49a0-a5d2-1c1fb25793f1 service nova] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e6c8932d-5085-4bc6-950d-3e4260551a0e req-5a1aac59-1641-49a0-a5d2-1c1fb25793f1 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e6c8932d-5085-4bc6-950d-3e4260551a0e req-5a1aac59-1641-49a0-a5d2-1c1fb25793f1 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-e6c8932d-5085-4bc6-950d-3e4260551a0e req-5a1aac59-1641-49a0-a5d2-1c1fb25793f1 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] No waiting events found dispatching network-vif-unplugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:55 user nova-compute[74959]: WARNING nova.compute.manager [req-e6c8932d-5085-4bc6-950d-3e4260551a0e req-5a1aac59-1641-49a0-a5d2-1c1fb25793f1 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received unexpected event network-vif-unplugged-465c6e1b-9eb2-470e-8647-8b43d80e945a for instance with vm_state active and task_state reboot_started_hard.
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8093ea-48fa-4a78-adcc-9718eb390611]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8999a900-9af0-49d0-a219-33b3ef6aa11e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ff2d00-382a-48a1-9ca5-fbc0242a4b86]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a, portal: 172.16.0.220,3260]
Nov 28 23:11:55 user nova-compute[74959]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a, portal: 172.16.0.220,3260] successful.
Nov 28 23:11:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e448683-5845-4298-ada0-a4220ddc298a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ba3739-66d0-483f-8e15-e34e824ffc79]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] <== disconnect_volume: return (339ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:55 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Instance destroyed successfully.
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.objects.instance [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'resources' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412234085',display_name='tempest-TestMinimumBasicScenario-server-1412234085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412234085',id=29,image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBau4EJ6PoO60hxDpjDXtquKde7d8Fp4tkYkc6XbpCFwbVop8/hgrcVzm9kBtN1WxHcF6o3d4i5XIQU2FPN6DN/V00LAqAHBgfvo/Kr7i4ZQV5XV/dtZ0mZIaxiaE0AknA==',key_name='tempest-TestMinimumBasicScenario-2066449073',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-c4w6rkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:11:55Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=d4c21a2d-bc24-4c8d-9703-7aa61f62713e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_vif [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap465c6e1b-9e, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48da86b6-032a-4b59-a1c0-d280991bd549) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:55 user nova-compute[74959]: INFO os_vif [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e')
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUvkWiXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:55 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bbb20c-8925-4f07-a2f4-e791f9ddc971]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:11:55 user nova-compute[74959]: No targets found.
Nov 28 23:11:55 user nova-compute[74959]: iSNS:
Nov 28 23:11:55 user nova-compute[74959]: No targets found.
Nov 28 23:11:55 user nova-compute[74959]: STATIC:
Nov 28 23:11:55 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:11:55 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:55 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:55 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:11:55 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:55 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:55 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:11:55 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:55 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:55 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:11:55 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:55 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:55 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd
Nov 28 23:11:55 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:11:55 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:11:55 user nova-compute[74959]: FIRMWARE:
Nov 28 23:11:55 user nova-compute[74959]: No targets found.
Nov 28 23:11:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:11:55 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:11:55 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3656642-7692-4c50-a7b1-9751679bcad4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054d07e-4eb5-473e-9b54-f4ca724e1558]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:55 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:55 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:55 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:55 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:55 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:55 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:55 user nova-compute[74959]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:55 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec366170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802'): ({'sdf'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Removing single pathed devices sdf {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[03355463-bdf6-42b0-b94c-dd4be34c147f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df189b-32ba-4266-b335-50c4e88806e4]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flushing IO for device /dev/sdf {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f2dbb-d172-40b5-8132-1f7d6fe4a34e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a31675-4aa4-4649-82a9-4d95abf03c32]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[60079d41-5a01-4b5e-803a-cc330b1e569f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[379968ed-370e-496b-bfbd-1a3a2addaa7a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260]
Nov 28 23:11:55 user nova-compute[74959]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260] successful.
Nov 28 23:11:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab435667-9ea6-41f1-b1ee-6e2c0eba0ed8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] <== disconnect_volume: return (322ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Start _get_guest_xml network_info=[{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d64a9a23-1ca3-4eba-8b25-b69652cc9814,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'd64a9a23-1ca3-4eba-8b25-b69652cc9814'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUvkWiXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd4c21a2d-bc24-4c8d-9703-7aa61f62713e', 'attached_at': '', 'detached_at': '', 'volume_id': '652ac64f-6454-4b76-b7de-19b2d70f4802', 'serial': '652ac64f-6454-4b76-b7de-19b2d70f4802'}, 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'dbd7f792-94e0-490e-b18b-c4eab21e2b11', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:11:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d64a9a23-1ca3-4eba-8b25-b69652cc9814,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.objects.instance [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.objects.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Object Instance<d4c21a2d-bc24-4c8d-9703-7aa61f62713e> lazy-loaded attributes: resources,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUvkWiXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:11:55 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:55 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:11:55 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e832a5da-82ca-4c56-a7d4-e8f3fe0855e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:11:55 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d782c8-4afd-46bc-ae3d-0c620df84c1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802] added
Nov 28 23:11:55 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1028e44-e2c5-4633-8579-e51210005cae]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[802302f6-e904-4ceb-9565-3c9b06f0796c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUvkWiXx {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUvkWiXx" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7be17f-a29f-4ade-b415-cc9bca2f27aa]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUvkWiXx'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0025f8-5ce0-4685-9d6e-14fd58b51a1a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9969b-919d-43f0-914f-63596a7e3c99]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'flavor' on Instance uuid d0c359b5-f676-47a2-9e6e-e83e1813206b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6f697e99-694a-4684-96e2-6e14ab41d488 tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.887s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbacfdb-95b1-4c62-beb8-199293d4dd8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260]
Nov 28 23:11:56 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260] successful.
Nov 28 23:11:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5580d2ec-bd78-4513-9de1-ee40005b330e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e812b83-f7ef-44ee-8df1-7a5a96d23b50]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:11:56 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:11:56 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e09645-dd6b-4300-8e73-3ce27786fe01]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:11:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-c1ea1bdb-2c9f-4d51-a5c1-b7d5602a0613 req-2b98e117-c80c-4bca-a124-3ce5316fd2fb service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c1ea1bdb-2c9f-4d51-a5c1-b7d5602a0613 req-2b98e117-c80c-4bca-a124-3ce5316fd2fb service nova] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c1ea1bdb-2c9f-4d51-a5c1-b7d5602a0613 req-2b98e117-c80c-4bca-a124-3ce5316fd2fb service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c1ea1bdb-2c9f-4d51-a5c1-b7d5602a0613 req-2b98e117-c80c-4bca-a124-3ce5316fd2fb service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-c1ea1bdb-2c9f-4d51-a5c1-b7d5602a0613 req-2b98e117-c80c-4bca-a124-3ce5316fd2fb service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] No waiting events found dispatching network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:57 user nova-compute[74959]: WARNING nova.compute.manager [req-c1ea1bdb-2c9f-4d51-a5c1-b7d5602a0613 req-2b98e117-c80c-4bca-a124-3ce5316fd2fb service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received unexpected event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a for instance with vm_state active and task_state reboot_started_hard.
Nov 28 23:11:57 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUvkWiXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26131636464316531', 'path': '/dev/sde'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131636464316531', 'path': '/dev/sde'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412234085',display_name='tempest-TestMinimumBasicScenario-server-1412234085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412234085',id=29,image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBau4EJ6PoO60hxDpjDXtquKde7d8Fp4tkYkc6XbpCFwbVop8/hgrcVzm9kBtN1WxHcF6o3d4i5XIQU2FPN6DN/V00LAqAHBgfvo/Kr7i4ZQV5XV/dtZ0mZIaxiaE0AknA==',key_name='tempest-TestMinimumBasicScenario-2066449073',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-c4w6rkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:11:55Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=d4c21a2d-bc24-4c8d-9703-7aa61f62713e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.objects.instance [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'pci_devices' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.objects.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Object Instance<d4c21a2d-bc24-4c8d-9703-7aa61f62713e> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:11:57 user nova-compute[74959]:   <uuid>d4c21a2d-bc24-4c8d-9703-7aa61f62713e</uuid>
Nov 28 23:11:57 user nova-compute[74959]:   <name>instance-0000001d</name>
Nov 28 23:11:57 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:11:57 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:11:57 user nova-compute[74959]:   <metadata>
Nov 28 23:11:57 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:11:57 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:11:57 user nova-compute[74959]:       <nova:name>tempest-TestMinimumBasicScenario-server-1412234085</nova:name>
Nov 28 23:11:57 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:11:55</nova:creationTime>
Nov 28 23:11:57 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:11:57 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:11:57 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:11:57 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:11:57 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:11:57 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:11:57 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:11:57 user nova-compute[74959]:       <nova:owner>
Nov 28 23:11:57 user nova-compute[74959]:         <nova:user uuid="d3b7bfca433f4f1ab07b34aa3b5faa42">tempest-TestMinimumBasicScenario-615443694-project-member</nova:user>
Nov 28 23:11:57 user nova-compute[74959]:         <nova:project uuid="b94592793a8e4345b9357f03062cca9a">tempest-TestMinimumBasicScenario-615443694</nova:project>
Nov 28 23:11:57 user nova-compute[74959]:       </nova:owner>
Nov 28 23:11:57 user nova-compute[74959]:       <nova:root type="image" uuid="d64a9a23-1ca3-4eba-8b25-b69652cc9814"/>
Nov 28 23:11:57 user nova-compute[74959]:       <nova:ports>
Nov 28 23:11:57 user nova-compute[74959]:         <nova:port uuid="465c6e1b-9eb2-470e-8647-8b43d80e945a">
Nov 28 23:11:57 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 23:11:57 user nova-compute[74959]:         </nova:port>
Nov 28 23:11:57 user nova-compute[74959]:       </nova:ports>
Nov 28 23:11:57 user nova-compute[74959]:     </nova:instance>
Nov 28 23:11:57 user nova-compute[74959]:   </metadata>
Nov 28 23:11:57 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:11:57 user nova-compute[74959]:     <system>
Nov 28 23:11:57 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:11:57 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:11:57 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:11:57 user nova-compute[74959]:       <entry name="serial">d4c21a2d-bc24-4c8d-9703-7aa61f62713e</entry>
Nov 28 23:11:57 user nova-compute[74959]:       <entry name="uuid">d4c21a2d-bc24-4c8d-9703-7aa61f62713e</entry>
Nov 28 23:11:57 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:11:57 user nova-compute[74959]:     </system>
Nov 28 23:11:57 user nova-compute[74959]:   </sysinfo>
Nov 28 23:11:57 user nova-compute[74959]:   <os>
Nov 28 23:11:57 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:11:57 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:11:57 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:11:57 user nova-compute[74959]:   </os>
Nov 28 23:11:57 user nova-compute[74959]:   <features>
Nov 28 23:11:57 user nova-compute[74959]:     <acpi/>
Nov 28 23:11:57 user nova-compute[74959]:     <apic/>
Nov 28 23:11:57 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:11:57 user nova-compute[74959]:   </features>
Nov 28 23:11:57 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:11:57 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:11:57 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:11:57 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:11:57 user nova-compute[74959]:   </clock>
Nov 28 23:11:57 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:11:57 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:11:57 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:11:57 user nova-compute[74959]:   </cpu>
Nov 28 23:11:57 user nova-compute[74959]:   <devices>
Nov 28 23:11:57 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:11:57 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:11:57 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk"/>
Nov 28 23:11:57 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:11:57 user nova-compute[74959]:     </disk>
Nov 28 23:11:57 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:11:57 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:11:57 user nova-compute[74959]:       <source dev="/dev/sde"/>
Nov 28 23:11:57 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:11:57 user nova-compute[74959]:       <serial>652ac64f-6454-4b76-b7de-19b2d70f4802</serial>
Nov 28 23:11:57 user nova-compute[74959]:     </disk>
Nov 28 23:11:57 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:11:57 user nova-compute[74959]:       <mac address="fa:16:3e:20:45:49"/>
Nov 28 23:11:57 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:11:57 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:11:57 user nova-compute[74959]:       <target dev="tap465c6e1b-9e"/>
Nov 28 23:11:57 user nova-compute[74959]:     </interface>
Nov 28 23:11:57 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:11:57 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/console.log" append="off"/>
Nov 28 23:11:57 user nova-compute[74959]:     </serial>
Nov 28 23:11:57 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:11:57 user nova-compute[74959]:     <video>
Nov 28 23:11:57 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:11:57 user nova-compute[74959]:     </video>
Nov 28 23:11:57 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:11:57 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:11:57 user nova-compute[74959]:     </rng>
Nov 28 23:11:57 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:11:57 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:11:57 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:11:57 user nova-compute[74959]:     </memballoon>
Nov 28 23:11:57 user nova-compute[74959]:   </devices>
Nov 28 23:11:57 user nova-compute[74959]: </domain>
Nov 28 23:11:57 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.objects.instance [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.objects.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Object Instance<d4c21a2d-bc24-4c8d-9703-7aa61f62713e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:11:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Cannot resize image /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'migration_context' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG nova.objects.base [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Object Instance<d4c21a2d-bc24-4c8d-9703-7aa61f62713e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412234085',display_name='tempest-TestMinimumBasicScenario-server-1412234085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412234085',id=29,image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBau4EJ6PoO60hxDpjDXtquKde7d8Fp4tkYkc6XbpCFwbVop8/hgrcVzm9kBtN1WxHcF6o3d4i5XIQU2FPN6DN/V00LAqAHBgfvo/Kr7i4ZQV5XV/dtZ0mZIaxiaE0AknA==',key_name='tempest-TestMinimumBasicScenario-2066449073',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-c4w6rkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:11:55Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=d4c21a2d-bc24-4c8d-9703-7aa61f62713e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG os_vif [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3deb969-36db-5958-99d6-18758da1df56', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap465c6e1b-9e, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap465c6e1b-9e, col_values=(('qos', UUID('d4d9bf61-fc77-48c2-bec0-9b3ec01ed3c0')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap465c6e1b-9e, col_values=(('external_ids', {'iface-id': '465c6e1b-9eb2-470e-8647-8b43d80e945a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:45:49', 'vm-uuid': 'd4c21a2d-bc24-4c8d-9703-7aa61f62713e'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:11:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:58 user nova-compute[74959]: INFO os_vif [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e')
Nov 28 23:11:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:11:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-418846d7-6df7-46bf-bc68-e0d741d33a37 req-29c8795a-19ab-40be-acce-2cfa45d4e915 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:11:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-418846d7-6df7-46bf-bc68-e0d741d33a37 req-29c8795a-19ab-40be-acce-2cfa45d4e915 service nova] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:11:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-418846d7-6df7-46bf-bc68-e0d741d33a37 req-29c8795a-19ab-40be-acce-2cfa45d4e915 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:11:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-418846d7-6df7-46bf-bc68-e0d741d33a37 req-29c8795a-19ab-40be-acce-2cfa45d4e915 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:11:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-418846d7-6df7-46bf-bc68-e0d741d33a37 req-29c8795a-19ab-40be-acce-2cfa45d4e915 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] No waiting events found dispatching network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:11:59 user nova-compute[74959]: WARNING nova.compute.manager [req-418846d7-6df7-46bf-bc68-e0d741d33a37 req-29c8795a-19ab-40be-acce-2cfa45d4e915 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received unexpected event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a for instance with vm_state active and task_state reboot_started_hard.
Nov 28 23:12:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFoywOdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:12:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:00 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90aed41-0f31-4c27-b128-a197ca174788]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:12:00 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3b3175-d3c1-4a26-86e2-2a4bd951d4b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b] added
Nov 28 23:12:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9d8cf3-6edb-4bd1-bfbe-96473651748b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0900bd-546f-42c6-bae5-051e519b1cff]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFoywOdG {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFoywOdG" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad3185a-417e-49bc-a760-77bd4b89de80]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFoywOdG'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c194780-5a94-4962-bfea-fdc453489da7]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c75654-bcd8-4a11-87df-77e4fab32463]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8fc00f-9618-49af-ac06-8c1b1d3a9ac1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b, portal: 172.16.0.220,3260]
Nov 28 23:12:00 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b, portal: 172.16.0.220,3260] successful.
Nov 28 23:12:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c337dec8-66af-4d5f-936c-42a98717afbc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fec4964-cf57-4d54-8bbd-dc25fbeb659e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:00 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[648e17d3-269c-4cc1-ac76-f08af68bd199]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:12:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFoywOdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26639663933636636', 'path': '/dev/sdf'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639663933636636', 'path': '/dev/sdf'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:12:01 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:12:01 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:12:01 user nova-compute[74959]:   <target dev="vdc" bus="virtio"/>
Nov 28 23:12:01 user nova-compute[74959]:   <serial>04141115-4e87-4d4f-ae83-4df279f41f9b</serial>
Nov 28 23:12:01 user nova-compute[74959]: </disk>
Nov 28 23:12:01 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-cf2dd151-4da2-4f33-9f28-d3a500ac8055 req-60d7d4a2-8f84-480f-81d1-fdfb1a98b0d4 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cf2dd151-4da2-4f33-9f28-d3a500ac8055 req-60d7d4a2-8f84-480f-81d1-fdfb1a98b0d4 service nova] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cf2dd151-4da2-4f33-9f28-d3a500ac8055 req-60d7d4a2-8f84-480f-81d1-fdfb1a98b0d4 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cf2dd151-4da2-4f33-9f28-d3a500ac8055 req-60d7d4a2-8f84-480f-81d1-fdfb1a98b0d4 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-cf2dd151-4da2-4f33-9f28-d3a500ac8055 req-60d7d4a2-8f84-480f-81d1-fdfb1a98b0d4 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] No waiting events found dispatching network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:01 user nova-compute[74959]: WARNING nova.compute.manager [req-cf2dd151-4da2-4f33-9f28-d3a500ac8055 req-60d7d4a2-8f84-480f-81d1-fdfb1a98b0d4 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received unexpected event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a for instance with vm_state active and task_state reboot_started_hard.
Nov 28 23:12:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:12:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Instance rebooted successfully.
Nov 28 23:12:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:12:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-201bab8e-ca48-431d-9b39-84ea4fccc30a tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.891s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] No VIF found with MAC fa:16:3e:05:e6:2a, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:12:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fdac44ca-a3ed-449b-9b3b-b14459d4bda6 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.813s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:03 user nova-compute[74959]: INFO nova.compute.manager [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Detaching volume c90d5c53-f147-4f50-a561-8a791776f2fd
Nov 28 23:12:03 user nova-compute[74959]: INFO nova.virt.block_device [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Attempting to driver detach volume c90d5c53-f147-4f50-a561-8a791776f2fd from mountpoint /dev/vdb
Nov 28 23:12:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Attempting to detach device vdb from instance dc9885ed-08ef-484c-89f6-97e4320217bc from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:12:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:12:03 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:12:03 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:12:03 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:12:03 user nova-compute[74959]:   <serial>c90d5c53-f147-4f50-a561-8a791776f2fd</serial>
Nov 28 23:12:03 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:12:03 user nova-compute[74959]: </disk>
Nov 28 23:12:03 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:12:03 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully detached device vdb from instance dc9885ed-08ef-484c-89f6-97e4320217bc from the persistent domain config.
Nov 28 23:12:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc9885ed-08ef-484c-89f6-97e4320217bc from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:12:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:12:03 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:12:03 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:12:03 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:12:03 user nova-compute[74959]:   <serial>c90d5c53-f147-4f50-a561-8a791776f2fd</serial>
Nov 28 23:12:03 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:12:03 user nova-compute[74959]: </disk>
Nov 28 23:12:03 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:12:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:12:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dc9885ed-08ef-484c-89f6-97e4320217bc is timed out.
Nov 28 23:12:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully detached device vdb from instance dc9885ed-08ef-484c-89f6-97e4320217bc from the live domain config.
Nov 28 23:12:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AWNGqovn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:12:24 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe82309-226d-4974-a10c-715b9b6ed349]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:12:24 user nova-compute[74959]: No targets found.
Nov 28 23:12:24 user nova-compute[74959]: iSNS:
Nov 28 23:12:24 user nova-compute[74959]: No targets found.
Nov 28 23:12:24 user nova-compute[74959]: STATIC:
Nov 28 23:12:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b
Nov 28 23:12:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:12:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:12:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:12:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:12:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd
Nov 28 23:12:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:24 user nova-compute[74959]: FIRMWARE:
Nov 28 23:12:24 user nova-compute[74959]: No targets found.
Nov 28 23:12:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:12:24 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:12:24 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c3b04-0cb2-40a7-a4d0-0d20befaf976]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e75cbb-d029-4a05-a67d-791af83bde34]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:24 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc58c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd'): ({'sdg'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Removing single pathed devices sdg {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c58762-64a7-49d8-8a56-fe468eb63e0b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce728679-3cab-4803-a83e-a1a4c8a6e661]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flushing IO for device /dev/sdg {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[015d5d4d-50eb-428f-a8fa-43898b5a6ae7]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b9f9bb-8040-4fb6-b5d2-7c2e2a53b1b7]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7131d01-d977-4730-913e-afbcc155305a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d1a44-f2d3-4236-b138-f65c20da5da2]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd, portal: 172.16.0.220,3260]
Nov 28 23:12:24 user nova-compute[74959]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd, portal: 172.16.0.220,3260] successful.
Nov 28 23:12:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c90d5c53-f147-4f50-a561-8a791776f2fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2ac19d-4791-4aef-aa69-fc855526ad08]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== disconnect_volume: return (313ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:24 user nova-compute[74959]: INFO nova.compute.manager [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Terminating instance
Nov 28 23:12:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-9bb698d4-5a7b-46fb-b170-84517b6678f1 req-4ab8cedf-4082-45e2-a585-d50de20e8288 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received event network-vif-unplugged-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9bb698d4-5a7b-46fb-b170-84517b6678f1 req-4ab8cedf-4082-45e2-a585-d50de20e8288 service nova] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9bb698d4-5a7b-46fb-b170-84517b6678f1 req-4ab8cedf-4082-45e2-a585-d50de20e8288 service nova] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9bb698d4-5a7b-46fb-b170-84517b6678f1 req-4ab8cedf-4082-45e2-a585-d50de20e8288 service nova] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-9bb698d4-5a7b-46fb-b170-84517b6678f1 req-4ab8cedf-4082-45e2-a585-d50de20e8288 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] No waiting events found dispatching network-vif-unplugged-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-9bb698d4-5a7b-46fb-b170-84517b6678f1 req-4ab8cedf-4082-45e2-a585-d50de20e8288 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received event network-vif-unplugged-db47062d-08bc-466e-9e85-472b2c58f9c5 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Instance destroyed successfully.
Nov 28 23:12:25 user nova-compute[74959]: DEBUG nova.objects.instance [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lazy-loading 'resources' on Instance uuid d0c359b5-f676-47a2-9e6e-e83e1813206b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1706459353',display_name='tempest-AttachVolumeNegativeTest-server-1706459353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1706459353',id=28,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAMmCF0LQCh7VRVGEbHICZFjofwCOvLd25CBPgLOxDrjGw6O/EUnBLbN2EOOAoJAyGRzBj9Of+7FA+DHf1OHzn4rec/lTg2DE+Uy0Lp0gHntT/2SH4FGpDOSJ16Kbp3GQ==',key_name='tempest-keypair-1358675322',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:09:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c57e434911c407189c1801142c226e1',ramdisk_id='',reservation_id='r-tygvo02a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1174707224',owner_user_name='tempest-AttachVolumeNegativeTest-1174707224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11f0d2814e7e4df6904596bc07befe0e',uuid=d0c359b5-f676-47a2-9e6e-e83e1813206b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converting VIF {"id": "db47062d-08bc-466e-9e85-472b2c58f9c5", "address": "fa:16:3e:ef:52:ac", "network": {"id": "aef8f0cf-c99f-442b-af04-8816e1686106", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441582242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c57e434911c407189c1801142c226e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb47062d-08", "ovs_interfaceid": "db47062d-08bc-466e-9e85-472b2c58f9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=db47062d-08bc-466e-9e85-472b2c58f9c5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb47062d-08') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG os_vif [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=db47062d-08bc-466e-9e85-472b2c58f9c5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb47062d-08') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb47062d-08, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f1dbc886-3dcd-4b0a-857f-4cdc9d55d011 tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.747s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c755d06-9945-48a1-b7c7-25a27aae0972) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:12:25 user nova-compute[74959]: INFO os_vif [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:52:ac,bridge_name='br-int',has_traffic_filtering=True,id=db47062d-08bc-466e-9e85-472b2c58f9c5,network=Network(aef8f0cf-c99f-442b-af04-8816e1686106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb47062d-08')
Nov 28 23:12:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Deleting instance files /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b_del
Nov 28 23:12:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Deletion of /opt/stack/data/nova/instances/d0c359b5-f676-47a2-9e6e-e83e1813206b_del complete
Nov 28 23:12:25 user nova-compute[74959]: INFO nova.compute.manager [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 23:12:25 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:12:25 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:26 user nova-compute[74959]: INFO nova.compute.manager [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Detaching volume 04141115-4e87-4d4f-ae83-4df279f41f9b
Nov 28 23:12:26 user nova-compute[74959]: INFO nova.virt.block_device [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Attempting to driver detach volume 04141115-4e87-4d4f-ae83-4df279f41f9b from mountpoint /dev/vdc
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Attempting to detach device vdc from instance dc9885ed-08ef-484c-89f6-97e4320217bc from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:12:26 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:12:26 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:12:26 user nova-compute[74959]:   <target dev="vdc" bus="virtio"/>
Nov 28 23:12:26 user nova-compute[74959]:   <serial>04141115-4e87-4d4f-ae83-4df279f41f9b</serial>
Nov 28 23:12:26 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 23:12:26 user nova-compute[74959]: </disk>
Nov 28 23:12:26 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:12:26 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully detached device vdc from instance dc9885ed-08ef-484c-89f6-97e4320217bc from the persistent domain config.
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dc9885ed-08ef-484c-89f6-97e4320217bc from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:12:26 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:12:26 user nova-compute[74959]:   <source dev="/dev/sdf"/>
Nov 28 23:12:26 user nova-compute[74959]:   <target dev="vdc" bus="virtio"/>
Nov 28 23:12:26 user nova-compute[74959]:   <serial>04141115-4e87-4d4f-ae83-4df279f41f9b</serial>
Nov 28 23:12:26 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 23:12:26 user nova-compute[74959]: </disk>
Nov 28 23:12:26 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:26 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Took 0.96 seconds to deallocate network for instance.
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-1d6dc7d2-bb89-461a-924e-1fd701285148 req-fc683b61-d2c0-42bd-aa3b-27086cda216e service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received event network-vif-deleted-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:26 user nova-compute[74959]: INFO nova.compute.manager [req-1d6dc7d2-bb89-461a-924e-1fd701285148 req-fc683b61-d2c0-42bd-aa3b-27086cda216e service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Neutron deleted interface db47062d-08bc-466e-9e85-472b2c58f9c5; detaching it from the instance and deleting it from the info cache
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-1d6dc7d2-bb89-461a-924e-1fd701285148 req-fc683b61-d2c0-42bd-aa3b-27086cda216e service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-1d6dc7d2-bb89-461a-924e-1fd701285148 req-fc683b61-d2c0-42bd-aa3b-27086cda216e service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Detach interface failed, port_id=db47062d-08bc-466e-9e85-472b2c58f9c5, reason: Instance d0c359b5-f676-47a2-9e6e-e83e1813206b could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:12:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:26 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Deleted allocations for instance d0c359b5-f676-47a2-9e6e-e83e1813206b
Nov 28 23:12:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-14400de3-f937-4d44-b771-549dc3c537ba tempest-AttachVolumeNegativeTest-1174707224 tempest-AttachVolumeNegativeTest-1174707224-project-member] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.415s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-cff1fb2c-0f5b-4bbc-8cde-a53e4e8850a0 req-bc6cc468-ed64-44be-9118-e502532ced17 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received event network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cff1fb2c-0f5b-4bbc-8cde-a53e4e8850a0 req-bc6cc468-ed64-44be-9118-e502532ced17 service nova] Acquiring lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cff1fb2c-0f5b-4bbc-8cde-a53e4e8850a0 req-bc6cc468-ed64-44be-9118-e502532ced17 service nova] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cff1fb2c-0f5b-4bbc-8cde-a53e4e8850a0 req-bc6cc468-ed64-44be-9118-e502532ced17 service nova] Lock "d0c359b5-f676-47a2-9e6e-e83e1813206b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-cff1fb2c-0f5b-4bbc-8cde-a53e4e8850a0 req-bc6cc468-ed64-44be-9118-e502532ced17 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] No waiting events found dispatching network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:27 user nova-compute[74959]: WARNING nova.compute.manager [req-cff1fb2c-0f5b-4bbc-8cde-a53e4e8850a0 req-bc6cc468-ed64-44be-9118-e502532ced17 service nova] [instance: d0c359b5-f676-47a2-9e6e-e83e1813206b] Received unexpected event network-vif-plugged-db47062d-08bc-466e-9e85-472b2c58f9c5 for instance with vm_state deleted and task_state None.
Nov 28 23:12:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:31 user nova-compute[74959]: DEBUG nova.objects.instance [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'flavor' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.144s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:32 user nova-compute[74959]: INFO nova.compute.manager [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Attaching volume d29e40db-089e-49f8-86fa-9c86490d7ee5 to /dev/vdb
Nov 28 23:12:32 user nova-compute[74959]: DEBUG os_brick.utils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[302fa02b-ff64-4840-aac1-21cd5a555bdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ddd43-4687-48a2-9a78-1e4cd24316bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8016385f-89cc-4122-84db-95aee51addee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d015ddb-d293-4010-a172-227c625ada43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:12:32 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:12:32 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9ca921-a212-4067-9b32-08b5b1158e68]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG os_brick.utils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:12:32 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating existing volume attachment record: 16705bbd-0753-4152-b569-b55c7ace3584 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:12:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzmtcjnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:12:39 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:39 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:39 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f340d5db-614d-4a69-94d2-1f47888c16d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:12:39 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d09f624-686b-476c-bf3f-a63d63f61f1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5] added
Nov 28 23:12:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a80d915-f92a-4655-950f-518b897f29cc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0c065e-b060-41e9-b895-f7f684fd4511]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzmtcjnL {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzmtcjnL" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0569d46f-0fd5-4da2-bc27-ba1833f6c59c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HzmtcjnL'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a65fbf4-3614-4402-93b9-8991e5bee304]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[70691bc3-f688-4c96-92e1-e58d04c8bb4b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:39 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:39 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:39 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:39 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:39 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:39 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:39 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:39 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:12:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f363222-120c-4a52-a5fe-291470919aa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5, portal: 172.16.0.220,3260]
Nov 28 23:12:40 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5, portal: 172.16.0.220,3260] successful.
Nov 28 23:12:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3bb887-d7ac-4018-8952-dfa58ded84c1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd4aced-f7d4-434f-a0d9-93437ed7ae43]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:12:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:40 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:12:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b0272-9894-49a0-8a5e-3a03d3750477]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:12:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzmtcjnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26431313730333439', 'path': '/dev/sdg'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431313730333439', 'path': '/dev/sdg'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.objects.instance [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'flavor' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:12:41 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:12:41 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:12:41 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:12:41 user nova-compute[74959]:   <serial>d29e40db-089e-49f8-86fa-9c86490d7ee5</serial>
Nov 28 23:12:41 user nova-compute[74959]: </disk>
Nov 28 23:12:41 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-8fdf55ff-88cd-4da5-bb52-14262927f29a req-bf0b6c72-8ecb-49cb-a75a-0c403ef1ac68 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-8fdf55ff-88cd-4da5-bb52-14262927f29a req-bf0b6c72-8ecb-49cb-a75a-0c403ef1ac68 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing instance network info cache due to event network-changed-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8fdf55ff-88cd-4da5-bb52-14262927f29a req-bf0b6c72-8ecb-49cb-a75a-0c403ef1ac68 service nova] Acquiring lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8fdf55ff-88cd-4da5-bb52-14262927f29a req-bf0b6c72-8ecb-49cb-a75a-0c403ef1ac68 service nova] Acquired lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.network.neutron [req-8fdf55ff-88cd-4da5-bb52-14262927f29a req-bf0b6c72-8ecb-49cb-a75a-0c403ef1ac68 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Refreshing network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:41 user nova-compute[74959]: INFO nova.compute.manager [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Terminating instance
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No VIF found with MAC fa:16:3e:59:a3:92, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-73ba95c3-e3c8-490c-bdb9-5e1f81a81b0f tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.623s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-30f07012-d3b1-4514-a75e-b8c256570f88 req-c82cda23-80a3-42a5-8bf8-d335fe0b3c67 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-unplugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-30f07012-d3b1-4514-a75e-b8c256570f88 req-c82cda23-80a3-42a5-8bf8-d335fe0b3c67 service nova] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-30f07012-d3b1-4514-a75e-b8c256570f88 req-c82cda23-80a3-42a5-8bf8-d335fe0b3c67 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-30f07012-d3b1-4514-a75e-b8c256570f88 req-c82cda23-80a3-42a5-8bf8-d335fe0b3c67 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-30f07012-d3b1-4514-a75e-b8c256570f88 req-c82cda23-80a3-42a5-8bf8-d335fe0b3c67 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] No waiting events found dispatching network-vif-unplugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-30f07012-d3b1-4514-a75e-b8c256570f88 req-c82cda23-80a3-42a5-8bf8-d335fe0b3c67 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-unplugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.network.neutron [req-8fdf55ff-88cd-4da5-bb52-14262927f29a req-bf0b6c72-8ecb-49cb-a75a-0c403ef1ac68 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updated VIF entry in instance network info cache for port 8b4e208b-60ed-496c-9c2a-94a3ec2bc70f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.network.neutron [req-8fdf55ff-88cd-4da5-bb52-14262927f29a req-bf0b6c72-8ecb-49cb-a75a-0c403ef1ac68 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [{"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8fdf55ff-88cd-4da5-bb52-14262927f29a req-bf0b6c72-8ecb-49cb-a75a-0c403ef1ac68 service nova] Releasing lock "refresh_cache-0bf7ba2c-355f-4ee4-8937-ad80724df48f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:12:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Instance destroyed successfully.
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.objects.instance [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lazy-loading 'resources' on Instance uuid 0bf7ba2c-355f-4ee4-8937-ad80724df48f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1099925087',display_name='tempest-TestShelveInstance-server-1099925087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1099925087',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUpUnh16KnhRFBjgrExrRBzAPZOMbfROnxIB/QzkB4XOJ4EkaMvtcMIzGiCMrfg7Ikqsa2yKPERXntT/PzeG19u5v85fNuNBonobsX6Lu/DYlmy81bO6leef1roSi+Sug==',key_name='tempest-TestShelveInstance-1413730831',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e326f1cb3b64f78b1cd0ef5adc09323',ramdisk_id='',reservation_id='r-owauny1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-19474985',owner_user_name='tempest-TestShelveInstance-19474985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:11:07Z,user_data=None,user_id='305832e59f9846b2923717725a362cbc',uuid=0bf7ba2c-355f-4ee4-8937-ad80724df48f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converting VIF {"id": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "address": "fa:16:3e:4c:d6:dd", "network": {"id": "f571af4e-ea80-4893-b71a-2813cb8b6934", "bridge": "br-int", "label": "tempest-TestShelveInstance-885676020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e326f1cb3b64f78b1cd0ef5adc09323", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4e208b-60", "ovs_interfaceid": "8b4e208b-60ed-496c-9c2a-94a3ec2bc70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_vif [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4e208b-60, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=537f6ddc-ef91-430b-881c-6767ca16e4c6) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:42 user nova-compute[74959]: INFO os_vif [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:dd,bridge_name='br-int',has_traffic_filtering=True,id=8b4e208b-60ed-496c-9c2a-94a3ec2bc70f,network=Network(f571af4e-ea80-4893-b71a-2813cb8b6934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4e208b-60')
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ePFtYNkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:12:42 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa3d0b2-4f83-43a0-bf85-523232a500e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:12:42 user nova-compute[74959]: No targets found.
Nov 28 23:12:42 user nova-compute[74959]: iSNS:
Nov 28 23:12:42 user nova-compute[74959]: No targets found.
Nov 28 23:12:42 user nova-compute[74959]: STATIC:
Nov 28 23:12:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b
Nov 28 23:12:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d
Nov 28 23:12:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:12:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:12:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:12:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:42 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5
Nov 28 23:12:42 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:42 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:42 user nova-compute[74959]: FIRMWARE:
Nov 28 23:12:42 user nova-compute[74959]: No targets found.
Nov 28 23:12:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:12:42 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:12:42 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6bb303-7d14-4b74-b83d-1d8ee5c88941]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ef7c4-0104-4f15-978f-b47083163d13]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:12:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:42 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:12:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef429f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03fd9e-ca65-4342-8a06-bf09255ebb33]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8f2433-c991-4bf1-a656-a60de1815832]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1fe93-a63f-438f-a6cf-f66e6ab0a98b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eac2584-ea4e-4706-bb13-82493865f59d]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ed1dfbc1', '/dev/disk/by-id/scsi-26563613532376232', '/dev/disk/by-id/scsi-1SCST_BIOed1dfbc1-eca527b241cf4be4') {{(pid=86637) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcfcad4-cc7a-4f53-ab8f-eacaa91b3f30]: (4, None) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eb5964-bd02-4fa3-8aa7-361337148635]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f45daa-be1d-4b2d-a1e4-f1e484553ce8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260]
Nov 28 23:12:42 user nova-compute[74959]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d, portal: 172.16.0.220,3260] successful.
Nov 28 23:12:42 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19243a0-5492-45aa-a078-6f57542bdf9f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] <== disconnect_volume: return (419ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:12:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Deleting instance files /opt/stack/data/nova/instances/0bf7ba2c-355f-4ee4-8937-ad80724df48f_del
Nov 28 23:12:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Deletion of /opt/stack/data/nova/instances/0bf7ba2c-355f-4ee4-8937-ad80724df48f_del complete
Nov 28 23:12:42 user nova-compute[74959]: INFO nova.compute.manager [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 28 23:12:42 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:12:42 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:12:43 user nova-compute[74959]: INFO nova.compute.manager [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Rescuing
Nov 28 23:12:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquired lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:43 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Took 0.73 seconds to deallocate network for instance.
Nov 28 23:12:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-36131404-95c3-4201-a816-8ee116a05476 req-a3980426-4473-40d0-8372-9205c6422af7 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-deleted-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating instance_info_cache with network_info: [{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Releasing lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-b20d03de-f852-4f0b-b194-b6d9ff02854c req-60a19881-e16d-498b-945b-de0d3699be64 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b20d03de-f852-4f0b-b194-b6d9ff02854c req-60a19881-e16d-498b-945b-de0d3699be64 service nova] Acquiring lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b20d03de-f852-4f0b-b194-b6d9ff02854c req-60a19881-e16d-498b-945b-de0d3699be64 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b20d03de-f852-4f0b-b194-b6d9ff02854c req-60a19881-e16d-498b-945b-de0d3699be64 service nova] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-b20d03de-f852-4f0b-b194-b6d9ff02854c req-60a19881-e16d-498b-945b-de0d3699be64 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] No waiting events found dispatching network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:44 user nova-compute[74959]: WARNING nova.compute.manager [req-b20d03de-f852-4f0b-b194-b6d9ff02854c req-60a19881-e16d-498b-945b-de0d3699be64 service nova] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Received unexpected event network-vif-plugged-8b4e208b-60ed-496c-9c2a-94a3ec2bc70f for instance with vm_state active and task_state deleting.
Nov 28 23:12:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:12:44 user nova-compute[74959]: INFO nova.compute.manager [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Took 0.84 seconds to detach 1 volumes for instance.
Nov 28 23:12:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] [instance: 0bf7ba2c-355f-4ee4-8937-ad80724df48f] Deleting volume: f8f1e585-54e6-4ce6-8f3e-f9ed70bf053d {{(pid=74959) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:12:44 user nova-compute[74959]: INFO nova.compute.claims [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Claim successful on node user
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:44 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance destroyed successfully.
Nov 28 23:12:44 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Attempting a stable device rescue
Nov 28 23:12:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74959) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance directory exists: not creating {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 23:12:44 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Creating image(s)
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "982aecd7f62a882404d74f1d2f4a28742652ce69" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "982aecd7f62a882404d74f1d2f4a28742652ce69" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:46 user nova-compute[74959]: WARNING nova.compute.manager [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state active and task_state rescuing.
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:46 user nova-compute[74959]: WARNING nova.compute.manager [req-d5b0ebe7-bdad-484e-a526-356e58f832b6 req-420d3886-5651-4ba6-aae9-f7990413d791 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state active and task_state rescuing.
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.virt.images [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] 000c0a98-43f4-4c98-b59c-a1501419cb53 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69.part /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.945s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.878s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.network.neutron [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:12:46 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:12:46 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance dc9885ed-08ef-484c-89f6-97e4320217bc is timed out.
Nov 28 23:12:46 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully detached device vdc from instance dc9885ed-08ef-484c-89f6-97e4320217bc from the live domain config.
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFoywOdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:12:46 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c0a586-8d72-491b-9fdd-618986862620]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:12:46 user nova-compute[74959]: No targets found.
Nov 28 23:12:46 user nova-compute[74959]: iSNS:
Nov 28 23:12:46 user nova-compute[74959]: No targets found.
Nov 28 23:12:46 user nova-compute[74959]: STATIC:
Nov 28 23:12:46 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b
Nov 28 23:12:46 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:46 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:46 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:12:46 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:46 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:46 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:12:46 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:46 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:46 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:12:46 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:46 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:46 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5
Nov 28 23:12:46 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:12:46 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:12:46 user nova-compute[74959]: FIRMWARE:
Nov 28 23:12:46 user nova-compute[74959]: No targets found.
Nov 28 23:12:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:12:46 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:12:46 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69.part /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69.converted" returned: 0 in 0.559s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5580a82a-cb92-4d7c-aeea-7cd9ad83cf1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG nova.policy [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a59fecc5b484491ca4f6b326d8bfcb67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69f1c42c1314a41ac6a4ae41fb64c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e9d3c2-4ead-4bf3-bfc4-8c283c39b5e7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:46 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:46 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:46 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:46 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:12:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:46 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:46 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:46 user nova-compute[74959]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b (non-flash)
Nov 28 23:12:46 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:12:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc580e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b'): ({'sdf'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Removing single pathed devices sdf {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:12:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:12:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Creating image(s)
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb16603-adfa-4148-9164-eb0c4d9ea0c3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea6a794-825f-4077-aebf-d2ef1ccf8359]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Flushing IO for device /dev/sdf {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "982aecd7f62a882404d74f1d2f4a28742652ce69" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.295s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "982aecd7f62a882404d74f1d2f4a28742652ce69" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "982aecd7f62a882404d74f1d2f4a28742652ce69" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2e4c01-ec17-4496-b88a-939e990d8fd4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef8a835-3b23-4f36-8905-1676e5695420]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] SCSI volumes sdf have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69 --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69,backing_fmt=raw /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6cffcc-b9d0-4287-a3b3-de9c6bf90d60]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69,backing_fmt=raw /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue" returned: 0 in 0.062s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "982aecd7f62a882404d74f1d2f4a28742652ce69" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'migration_context' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.objects.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Object Instance<63d3691b-4d3d-44ca-ab1a-d778d1ac7304> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Start _get_guest_xml network_info=[{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "vif_mac": "fa:16:3e:59:a3:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '000c0a98-43f4-4c98-b59c-a1501419cb53', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzmtcjnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '63d3691b-4d3d-44ca-ab1a-d778d1ac7304', 'attached_at': '', 'detached_at': '', 'volume_id': 'd29e40db-089e-49f8-86fa-9c86490d7ee5', 'serial': 'd29e40db-089e-49f8-86fa-9c86490d7ee5'}, 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '16705bbd-0753-4152-b569-b55c7ace3584', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'resources' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.objects.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Object Instance<63d3691b-4d3d-44ca-ab1a-d778d1ac7304> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'numa_topology' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.objects.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Object Instance<63d3691b-4d3d-44ca-ab1a-d778d1ac7304> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.991s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc01a49-f1e8-4d10-8653-9e3998b49ffb]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b, portal: 172.16.0.220,3260]
Nov 28 23:12:47 user nova-compute[74959]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b, portal: 172.16.0.220,3260] successful.
Nov 28 23:12:47 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:12:47 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.262s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Deleted allocations for instance 0bf7ba2c-355f-4ee4-8937-ad80724df48f
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04141115-4e87-4d4f-ae83-4df279f41f9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9360a9-cab3-43eb-90b9-430c2acfaf0c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.objects.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Object Instance<63d3691b-4d3d-44ca-ab1a-d778d1ac7304> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzmtcjnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:12:47 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.787s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] <== disconnect_volume: return (789ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.022s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:47 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:12:47 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk 1073741824" returned: 0 in 0.133s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d5dbe8-aacc-4b28-9916-18e26d4c727f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HzmtcjnL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 23:12:47 user nova-compute[74959]: node.name = iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5
Nov 28 23:12:47 user nova-compute[74959]: node.tpgt = -1
Nov 28 23:12:47 user nova-compute[74959]: node.startup = automatic
Nov 28 23:12:47 user nova-compute[74959]: node.leading_login = No
Nov 28 23:12:47 user nova-compute[74959]: iface.iscsi_ifacename = default
Nov 28 23:12:47 user nova-compute[74959]: iface.net_ifacename = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.ipaddress = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.prefix_len = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.hwaddress = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.transport_name = tcp
Nov 28 23:12:47 user nova-compute[74959]: iface.initiatorname = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.state = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.vlan_id = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.vlan_priority = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.vlan_state = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.iface_num = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.mtu = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.port = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.bootproto = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.subnet_mask = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.gateway = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.dhcp_alt_client_id = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.dhcp_dns = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.dhcp_learn_iqn = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.dhcp_vendor_id_state = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.dhcp_vendor_id = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.dhcp_slp_da = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.fragmentation = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.gratuitous_arp = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.incoming_forwarding = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.tos_state = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.tos = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.ttl = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.delayed_ack = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.tcp_nagle = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.tcp_wsf_state = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.tcp_wsf = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.tcp_timer_scale = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.tcp_timestamp = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.redirect = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.def_task_mgmt_timeout = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.header_digest = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.data_digest = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.immediate_data = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.initial_r2t = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.data_seq_inorder = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.data_pdu_inorder = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.erl = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.max_receive_data_len = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.first_burst_len = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.max_outstanding_r2t = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.max_burst_len = 0
Nov 28 23:12:47 user nova-compute[74959]: iface.chap_auth = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.bidi_chap = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.strict_login_compliance = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.discovery_auth = <empty>
Nov 28 23:12:47 user nova-compute[74959]: iface.discovery_logout = <empty>
Nov 28 23:12:47 user nova-compute[74959]: node.discovery_address = <empty>
Nov 28 23:12:47 user nova-compute[74959]: node.discovery_port = 0
Nov 28 23:12:47 user nova-compute[74959]: node.discovery_type = static
Nov 28 23:12:47 user nova-compute[74959]: node.session.initial_cmdsn = 0
Nov 28 23:12:47 user nova-compute[74959]: node.session.initial_login_retry_max = 8
Nov 28 23:12:47 user nova-compute[74959]: node.session.xmit_thread_priority = -20
Nov 28 23:12:47 user nova-compute[74959]: node.session.cmds_max = 128
Nov 28 23:12:47 user nova-compute[74959]: node.session.queue_depth = 32
Nov 28 23:12:47 user nova-compute[74959]: node.session.nr_sessions = 1
Nov 28 23:12:47 user nova-compute[74959]: node.session.auth.authmethod = CHAP
Nov 28 23:12:47 user nova-compute[74959]: node.session.auth.username = HzmtcjnL
Nov 28 23:12:47 user nova-compute[74959]: node.session.auth.password = ***
Nov 28 23:12:47 user nova-compute[74959]: node.session.auth.username_in = <empty>
Nov 28 23:12:47 user nova-compute[74959]: node.session.auth.password_in = <empty>
Nov 28 23:12:47 user nova-compute[74959]: node.session.auth.chap_algs = MD5
Nov 28 23:12:47 user nova-compute[74959]: node.session.timeo.replacement_timeout = 120
Nov 28 23:12:47 user nova-compute[74959]: node.session.err_timeo.abort_timeout = 15
Nov 28 23:12:47 user nova-compute[74959]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 23:12:47 user nova-compute[74959]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 23:12:47 user nova-compute[74959]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.FastAbort = Yes
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.InitialR2T = No
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.ImmediateData = Yes
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.MaxConnections = 1
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 23:12:47 user nova-compute[74959]: node.session.iscsi.ERL = 0
Nov 28 23:12:47 user nova-compute[74959]: node.session.scan = manual
Nov 28 23:12:47 user nova-compute[74959]: node.session.reopen_max = 0
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].address = 172.16.0.220
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].port = 3260
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].startup = manual
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].tcp.window_size = 524288
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].tcp.type_of_service = 0
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].timeo.logout_timeout = 15
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].timeo.login_timeout = 15
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].timeo.auth_timeout = 45
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].iscsi.DataDigest = None
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].iscsi.IFMarker = No
Nov 28 23:12:47 user nova-compute[74959]: node.conn[0].iscsi.OFMarker = No
Nov 28 23:12:47 user nova-compute[74959]: # END RECORD
Nov 28 23:12:47 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Successfully created port: bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[98815a5f-3ee8-45a2-b758-9e853f54fe4f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95cef20b-f505-43ad-b748-0847ddcf96b3 tempest-TestShelveInstance-19474985 tempest-TestShelveInstance-19474985-project-member] Lock "0bf7ba2c-355f-4ee4-8937-ad80724df48f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.170s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a193211f-57ee-46ec-8c65-817d0e9ad610]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzmtcjnL {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HzmtcjnL" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de8ff5-006c-4d68-a0b9-06788cb26cd8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HzmtcjnL'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6f5a95-4d6c-40dc-a916-42fde241fd78]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddaf75b-d77a-48ef-bc8b-2f3d01cc9239]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:47 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:47 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:47 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:12:47 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:12:47 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:12:47 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:12:47 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:12:47 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.211s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] HCTL ('38', '0', '0', 0) found on session 38 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d32b59-9b67-4d88-98d6-32eaffc0dcc2]: (4, ('0 0 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Searching for a device in session 38 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzmtcjnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.266s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] <== connect_volume: return (288ms) {'type': 'block', 'scsi_wwn': '26431313730333439', 'path': '/dev/sdg'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:12:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431313730333439', 'path': '/dev/sdg'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Cannot resize image /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Ensure instance console log exists: /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-797958720',display_name='tempest-ServerStableDeviceRescueTest-server-797958720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-797958720',id=27,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwpnuwk3F4oQOUbvbeGHOHg77Y/1jNiciJERi9Nm37f3eKJeduzJ0yri0a7jRnXZu7o/hUCC83uhYv5J9OiUjya4c2oW4ivMUnAHM0Wmu33P6ssYkmPZv/AMPgZRp/Rpw==',key_name='tempest-keypair-138360968',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c8c0790fe9a4457aec8ddcc8630f2ec',ramdisk_id='',reservation_id='r-almgevc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-366574212',owner_user_name='tempest-ServerStableDeviceRescueTest-366574212-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74e434d4b70f4c95be8af313a665e7af',uuid=63d3691b-4d3d-44ca-ab1a-d778d1ac7304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "vif_mac": "fa:16:3e:59:a3:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Converting VIF {"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "vif_mac": "fa:16:3e:59:a3:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:a3:92,bridge_name='br-int',has_traffic_filtering=True,id=c897ce7f-6b41-4c61-9e90-56577c38cac7,network=Network(0e2291ed-66eb-4e96-9c11-f39100518417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc897ce7f-6b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'pci_devices' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.objects.base [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Object Instance<63d3691b-4d3d-44ca-ab1a-d778d1ac7304> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:12:48 user nova-compute[74959]:   <uuid>63d3691b-4d3d-44ca-ab1a-d778d1ac7304</uuid>
Nov 28 23:12:48 user nova-compute[74959]:   <name>instance-0000001b</name>
Nov 28 23:12:48 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:12:48 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:12:48 user nova-compute[74959]:   <metadata>
Nov 28 23:12:48 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:12:48 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:12:48 user nova-compute[74959]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-797958720</nova:name>
Nov 28 23:12:48 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:12:47</nova:creationTime>
Nov 28 23:12:48 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:12:48 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:12:48 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:12:48 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:12:48 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:12:48 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:12:48 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:12:48 user nova-compute[74959]:       <nova:owner>
Nov 28 23:12:48 user nova-compute[74959]:         <nova:user uuid="74e434d4b70f4c95be8af313a665e7af">tempest-ServerStableDeviceRescueTest-366574212-project-member</nova:user>
Nov 28 23:12:48 user nova-compute[74959]:         <nova:project uuid="3c8c0790fe9a4457aec8ddcc8630f2ec">tempest-ServerStableDeviceRescueTest-366574212</nova:project>
Nov 28 23:12:48 user nova-compute[74959]:       </nova:owner>
Nov 28 23:12:48 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:12:48 user nova-compute[74959]:       <nova:ports>
Nov 28 23:12:48 user nova-compute[74959]:         <nova:port uuid="c897ce7f-6b41-4c61-9e90-56577c38cac7">
Nov 28 23:12:48 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 23:12:48 user nova-compute[74959]:         </nova:port>
Nov 28 23:12:48 user nova-compute[74959]:       </nova:ports>
Nov 28 23:12:48 user nova-compute[74959]:     </nova:instance>
Nov 28 23:12:48 user nova-compute[74959]:   </metadata>
Nov 28 23:12:48 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:12:48 user nova-compute[74959]:     <system>
Nov 28 23:12:48 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:12:48 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:12:48 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:12:48 user nova-compute[74959]:       <entry name="serial">63d3691b-4d3d-44ca-ab1a-d778d1ac7304</entry>
Nov 28 23:12:48 user nova-compute[74959]:       <entry name="uuid">63d3691b-4d3d-44ca-ab1a-d778d1ac7304</entry>
Nov 28 23:12:48 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:12:48 user nova-compute[74959]:     </system>
Nov 28 23:12:48 user nova-compute[74959]:   </sysinfo>
Nov 28 23:12:48 user nova-compute[74959]:   <os>
Nov 28 23:12:48 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:12:48 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:12:48 user nova-compute[74959]:   </os>
Nov 28 23:12:48 user nova-compute[74959]:   <features>
Nov 28 23:12:48 user nova-compute[74959]:     <acpi/>
Nov 28 23:12:48 user nova-compute[74959]:     <apic/>
Nov 28 23:12:48 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:12:48 user nova-compute[74959]:   </features>
Nov 28 23:12:48 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:12:48 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:12:48 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:12:48 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:12:48 user nova-compute[74959]:   </clock>
Nov 28 23:12:48 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:12:48 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:12:48 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:12:48 user nova-compute[74959]:   </cpu>
Nov 28 23:12:48 user nova-compute[74959]:   <devices>
Nov 28 23:12:48 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:12:48 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:12:48 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk"/>
Nov 28 23:12:48 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:12:48 user nova-compute[74959]:     </disk>
Nov 28 23:12:48 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:12:48 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:12:48 user nova-compute[74959]:       <source dev="/dev/sdg"/>
Nov 28 23:12:48 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:12:48 user nova-compute[74959]:       <serial>d29e40db-089e-49f8-86fa-9c86490d7ee5</serial>
Nov 28 23:12:48 user nova-compute[74959]:     </disk>
Nov 28 23:12:48 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:12:48 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:12:48 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue"/>
Nov 28 23:12:48 user nova-compute[74959]:       <target dev="vdc" bus="virtio"/>
Nov 28 23:12:48 user nova-compute[74959]:       <boot order="1"/>
Nov 28 23:12:48 user nova-compute[74959]:     </disk>
Nov 28 23:12:48 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:12:48 user nova-compute[74959]:       <mac address="fa:16:3e:59:a3:92"/>
Nov 28 23:12:48 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:12:48 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:12:48 user nova-compute[74959]:       <target dev="tapc897ce7f-6b"/>
Nov 28 23:12:48 user nova-compute[74959]:     </interface>
Nov 28 23:12:48 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:12:48 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/console.log" append="off"/>
Nov 28 23:12:48 user nova-compute[74959]:     </serial>
Nov 28 23:12:48 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:12:48 user nova-compute[74959]:     <video>
Nov 28 23:12:48 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:12:48 user nova-compute[74959]:     </video>
Nov 28 23:12:48 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:12:48 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:12:48 user nova-compute[74959]:     </rng>
Nov 28 23:12:48 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:12:48 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:12:48 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:12:48 user nova-compute[74959]:     </memballoon>
Nov 28 23:12:48 user nova-compute[74959]:   </devices>
Nov 28 23:12:48 user nova-compute[74959]: </domain>
Nov 28 23:12:48 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:12:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance destroyed successfully.
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] No VIF found with MAC fa:16:3e:59:a3:92, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Successfully updated port: bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquired lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-b865adde-49d5-45d5-8c36-3dbe8a99e340 req-0e7fbdc4-a1ab-4039-9a6c-84a2a99857c0 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-changed-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-b865adde-49d5-45d5-8c36-3dbe8a99e340 req-0e7fbdc4-a1ab-4039-9a6c-84a2a99857c0 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Refreshing instance network info cache due to event network-changed-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b865adde-49d5-45d5-8c36-3dbe8a99e340 req-0e7fbdc4-a1ab-4039-9a6c-84a2a99857c0 service nova] Acquiring lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'flavor' on Instance uuid dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b94f59dc-8759-473f-9956-b1b10eed17bd tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.611s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Releasing lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance network_info: |[{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b865adde-49d5-45d5-8c36-3dbe8a99e340 req-0e7fbdc4-a1ab-4039-9a6c-84a2a99857c0 service nova] Acquired lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-b865adde-49d5-45d5-8c36-3dbe8a99e340 req-0e7fbdc4-a1ab-4039-9a6c-84a2a99857c0 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Refreshing network info cache for port bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:12:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Start _get_guest_xml network_info=[{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:12:49 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:12:49 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:12:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1569794857',display_name='tempest-ServerRescueNegativeTestJSON-server-1569794857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1569794857',id=33,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVysS3wm5gNN0sa78SgQSsn8xRGlM6MBHgrhRblr4un5CiVi8uL0dJtSlnH30HwHIymOKFVZsbT5qxsOmGiH4UEop/VlBkYS3j1EyzNlJ0IoLKCaCARh1LupX6FPx3Ang==',key_name='tempest-keypair-30517445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-r9arql55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=4645bea5-5301-4394-9ad8-0bc352a99dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:4f,bridge_name='br-int',has_traffic_filtering=True,id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf941ff4-5a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.objects.instance [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'pci_devices' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:12:49 user nova-compute[74959]:   <uuid>4645bea5-5301-4394-9ad8-0bc352a99dda</uuid>
Nov 28 23:12:49 user nova-compute[74959]:   <name>instance-00000021</name>
Nov 28 23:12:49 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:12:49 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:12:49 user nova-compute[74959]:   <metadata>
Nov 28 23:12:49 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:12:49 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:12:49 user nova-compute[74959]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1569794857</nova:name>
Nov 28 23:12:49 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:12:49</nova:creationTime>
Nov 28 23:12:49 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:12:49 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:12:49 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:12:49 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:12:49 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:12:49 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:12:49 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:12:49 user nova-compute[74959]:       <nova:owner>
Nov 28 23:12:49 user nova-compute[74959]:         <nova:user uuid="a59fecc5b484491ca4f6b326d8bfcb67">tempest-ServerRescueNegativeTestJSON-1452838145-project-member</nova:user>
Nov 28 23:12:49 user nova-compute[74959]:         <nova:project uuid="d69f1c42c1314a41ac6a4ae41fb64c7c">tempest-ServerRescueNegativeTestJSON-1452838145</nova:project>
Nov 28 23:12:49 user nova-compute[74959]:       </nova:owner>
Nov 28 23:12:49 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:12:49 user nova-compute[74959]:       <nova:ports>
Nov 28 23:12:49 user nova-compute[74959]:         <nova:port uuid="bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd">
Nov 28 23:12:49 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 23:12:49 user nova-compute[74959]:         </nova:port>
Nov 28 23:12:49 user nova-compute[74959]:       </nova:ports>
Nov 28 23:12:49 user nova-compute[74959]:     </nova:instance>
Nov 28 23:12:49 user nova-compute[74959]:   </metadata>
Nov 28 23:12:49 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:12:49 user nova-compute[74959]:     <system>
Nov 28 23:12:49 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:12:49 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:12:49 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:12:49 user nova-compute[74959]:       <entry name="serial">4645bea5-5301-4394-9ad8-0bc352a99dda</entry>
Nov 28 23:12:49 user nova-compute[74959]:       <entry name="uuid">4645bea5-5301-4394-9ad8-0bc352a99dda</entry>
Nov 28 23:12:49 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:12:49 user nova-compute[74959]:     </system>
Nov 28 23:12:49 user nova-compute[74959]:   </sysinfo>
Nov 28 23:12:49 user nova-compute[74959]:   <os>
Nov 28 23:12:49 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:12:49 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:12:49 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:12:49 user nova-compute[74959]:   </os>
Nov 28 23:12:49 user nova-compute[74959]:   <features>
Nov 28 23:12:49 user nova-compute[74959]:     <acpi/>
Nov 28 23:12:49 user nova-compute[74959]:     <apic/>
Nov 28 23:12:49 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:12:49 user nova-compute[74959]:   </features>
Nov 28 23:12:49 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:12:49 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:12:49 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:12:49 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:12:49 user nova-compute[74959]:   </clock>
Nov 28 23:12:49 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:12:49 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:12:49 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:12:49 user nova-compute[74959]:   </cpu>
Nov 28 23:12:49 user nova-compute[74959]:   <devices>
Nov 28 23:12:49 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:12:49 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:12:49 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk"/>
Nov 28 23:12:49 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:12:49 user nova-compute[74959]:     </disk>
Nov 28 23:12:49 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:12:49 user nova-compute[74959]:       <mac address="fa:16:3e:e7:e9:4f"/>
Nov 28 23:12:49 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:12:49 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:12:49 user nova-compute[74959]:       <target dev="tapbf941ff4-5a"/>
Nov 28 23:12:49 user nova-compute[74959]:     </interface>
Nov 28 23:12:49 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:12:49 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/console.log" append="off"/>
Nov 28 23:12:49 user nova-compute[74959]:     </serial>
Nov 28 23:12:49 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:12:49 user nova-compute[74959]:     <video>
Nov 28 23:12:49 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:12:49 user nova-compute[74959]:     </video>
Nov 28 23:12:49 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:12:49 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:12:49 user nova-compute[74959]:     </rng>
Nov 28 23:12:49 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:12:49 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:12:49 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:12:49 user nova-compute[74959]:     </memballoon>
Nov 28 23:12:49 user nova-compute[74959]:   </devices>
Nov 28 23:12:49 user nova-compute[74959]: </domain>
Nov 28 23:12:49 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1569794857',display_name='tempest-ServerRescueNegativeTestJSON-server-1569794857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1569794857',id=33,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVysS3wm5gNN0sa78SgQSsn8xRGlM6MBHgrhRblr4un5CiVi8uL0dJtSlnH30HwHIymOKFVZsbT5qxsOmGiH4UEop/VlBkYS3j1EyzNlJ0IoLKCaCARh1LupX6FPx3Ang==',key_name='tempest-keypair-30517445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-r9arql55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=4645bea5-5301-4394-9ad8-0bc352a99dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:4f,bridge_name='br-int',has_traffic_filtering=True,id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf941ff4-5a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG os_vif [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:4f,bridge_name='br-int',has_traffic_filtering=True,id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf941ff4-5a') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37525a77-187d-5551-a27a-617eb9f45c55', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf941ff4-5a, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf941ff4-5a, col_values=(('qos', UUID('bffb5f34-8fa5-4936-bc57-e46ec79d9235')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf941ff4-5a, col_values=(('external_ids', {'iface-id': 'bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:e9:4f', 'vm-uuid': '4645bea5-5301-4394-9ad8-0bc352a99dda'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:49 user nova-compute[74959]: INFO os_vif [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e9:4f,bridge_name='br-int',has_traffic_filtering=True,id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf941ff4-5a')
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No VIF found with MAC fa:16:3e:e7:e9:4f, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.network.neutron [req-b865adde-49d5-45d5-8c36-3dbe8a99e340 req-0e7fbdc4-a1ab-4039-9a6c-84a2a99857c0 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updated VIF entry in instance network info cache for port bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG nova.network.neutron [req-b865adde-49d5-45d5-8c36-3dbe8a99e340 req-0e7fbdc4-a1ab-4039-9a6c-84a2a99857c0 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b865adde-49d5-45d5-8c36-3dbe8a99e340 req-0e7fbdc4-a1ab-4039-9a6c-84a2a99857c0 service nova] Releasing lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:12:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-1887c1f4-bebe-4141-addf-2f99d19de4fc req-02fa3706-af87-451a-ada9-45bf1e39cfe0 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1887c1f4-bebe-4141-addf-2f99d19de4fc req-02fa3706-af87-451a-ada9-45bf1e39cfe0 service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1887c1f4-bebe-4141-addf-2f99d19de4fc req-02fa3706-af87-451a-ada9-45bf1e39cfe0 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1887c1f4-bebe-4141-addf-2f99d19de4fc req-02fa3706-af87-451a-ada9-45bf1e39cfe0 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-1887c1f4-bebe-4141-addf-2f99d19de4fc req-02fa3706-af87-451a-ada9-45bf1e39cfe0 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:50 user nova-compute[74959]: WARNING nova.compute.manager [req-1887c1f4-bebe-4141-addf-2f99d19de4fc req-02fa3706-af87-451a-ada9-45bf1e39cfe0 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state active and task_state rescuing.
Nov 28 23:12:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:50 user nova-compute[74959]: INFO nova.compute.manager [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Terminating instance
Nov 28 23:12:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-53902663-7ccb-4510-954f-ac19b5b8ac5c req-5bfe5c69-e852-44f7-9ae7-6de0fdf3fdaa service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received event network-vif-unplugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-53902663-7ccb-4510-954f-ac19b5b8ac5c req-5bfe5c69-e852-44f7-9ae7-6de0fdf3fdaa service nova] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-53902663-7ccb-4510-954f-ac19b5b8ac5c req-5bfe5c69-e852-44f7-9ae7-6de0fdf3fdaa service nova] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-53902663-7ccb-4510-954f-ac19b5b8ac5c req-5bfe5c69-e852-44f7-9ae7-6de0fdf3fdaa service nova] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-53902663-7ccb-4510-954f-ac19b5b8ac5c req-5bfe5c69-e852-44f7-9ae7-6de0fdf3fdaa service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] No waiting events found dispatching network-vif-unplugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-53902663-7ccb-4510-954f-ac19b5b8ac5c req-5bfe5c69-e852-44f7-9ae7-6de0fdf3fdaa service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received event network-vif-unplugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-cb43fcd3-8141-4c11-a44c-1af2dfd6b858 req-e9fb8536-0161-42f0-a5cb-814dcb47b7f3 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cb43fcd3-8141-4c11-a44c-1af2dfd6b858 req-e9fb8536-0161-42f0-a5cb-814dcb47b7f3 service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cb43fcd3-8141-4c11-a44c-1af2dfd6b858 req-e9fb8536-0161-42f0-a5cb-814dcb47b7f3 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-cb43fcd3-8141-4c11-a44c-1af2dfd6b858 req-e9fb8536-0161-42f0-a5cb-814dcb47b7f3 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-cb43fcd3-8141-4c11-a44c-1af2dfd6b858 req-e9fb8536-0161-42f0-a5cb-814dcb47b7f3 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:51 user nova-compute[74959]: WARNING nova.compute.manager [req-cb43fcd3-8141-4c11-a44c-1af2dfd6b858 req-e9fb8536-0161-42f0-a5cb-814dcb47b7f3 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state building and task_state spawning.
Nov 28 23:12:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Instance destroyed successfully.
Nov 28 23:12:52 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lazy-loading 'resources' on Instance uuid dc9885ed-08ef-484c-89f6-97e4320217bc {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-586580815',display_name='tempest-AttachVolumeTestJSON-server-586580815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-586580815',id=30,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCD10hjk4a8cjjPITQ/gaOzg8i2DfIZKTkNGwxTffjnPZSwKAHJBPskMEBL02EvrznCxLxGMUHIK1kGNpdCKSo993mRCw+FhBsS/I23eAOHdYWWQV53QFPz/1KaITZ+8g==',key_name='tempest-keypair-1066556271',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c95b70a9bba84ebc95d6d7aea0d8c649',ramdisk_id='',reservation_id='r-j8oa2ot4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-803300239',owner_user_name='tempest-AttachVolumeTestJSON-803300239-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2c8fce9ab041ba928f65f59468683e',uuid=dc9885ed-08ef-484c-89f6-97e4320217bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converting VIF {"id": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "address": "fa:16:3e:05:e6:2a", "network": {"id": "b719749c-2474-433a-b5ec-a2b1105efc9d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1154056795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c95b70a9bba84ebc95d6d7aea0d8c649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d08f4d-04", "ovs_interfaceid": "27d08f4d-04eb-4dcd-ab2f-a5f730917f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:e6:2a,bridge_name='br-int',has_traffic_filtering=True,id=27d08f4d-04eb-4dcd-ab2f-a5f730917f09,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d08f4d-04') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG os_vif [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:e6:2a,bridge_name='br-int',has_traffic_filtering=True,id=27d08f4d-04eb-4dcd-ab2f-a5f730917f09,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d08f4d-04') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27d08f4d-04, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a86a241a-8006-4598-9b13-10ee0da0c57f) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:52 user nova-compute[74959]: INFO os_vif [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:e6:2a,bridge_name='br-int',has_traffic_filtering=True,id=27d08f4d-04eb-4dcd-ab2f-a5f730917f09,network=Network(b719749c-2474-433a-b5ec-a2b1105efc9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d08f4d-04')
Nov 28 23:12:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Deleting instance files /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc_del
Nov 28 23:12:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Deletion of /opt/stack/data/nova/instances/dc9885ed-08ef-484c-89f6-97e4320217bc_del complete
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:52 user nova-compute[74959]: INFO nova.compute.manager [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:53 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Took 0.83 seconds to deallocate network for instance.
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-4c111f97-74c7-4fd0-a71f-234b10a6bfe5 req-6cef68ec-b16f-42dc-8056-131559b5409a service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4c111f97-74c7-4fd0-a71f-234b10a6bfe5 req-6cef68ec-b16f-42dc-8056-131559b5409a service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4c111f97-74c7-4fd0-a71f-234b10a6bfe5 req-6cef68ec-b16f-42dc-8056-131559b5409a service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4c111f97-74c7-4fd0-a71f-234b10a6bfe5 req-6cef68ec-b16f-42dc-8056-131559b5409a service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-4c111f97-74c7-4fd0-a71f-234b10a6bfe5 req-6cef68ec-b16f-42dc-8056-131559b5409a service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:53 user nova-compute[74959]: WARNING nova.compute.manager [req-4c111f97-74c7-4fd0-a71f-234b10a6bfe5 req-6cef68ec-b16f-42dc-8056-131559b5409a service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state active and task_state rescuing.
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-4c111f97-74c7-4fd0-a71f-234b10a6bfe5 req-6cef68ec-b16f-42dc-8056-131559b5409a service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received event network-vif-deleted-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-5387b3c2-d18c-4fef-b173-d8bb1b31c52d req-c04d3002-3626-477d-9b06-2985e9e151ca service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received event network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5387b3c2-d18c-4fef-b173-d8bb1b31c52d req-c04d3002-3626-477d-9b06-2985e9e151ca service nova] Acquiring lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5387b3c2-d18c-4fef-b173-d8bb1b31c52d req-c04d3002-3626-477d-9b06-2985e9e151ca service nova] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5387b3c2-d18c-4fef-b173-d8bb1b31c52d req-c04d3002-3626-477d-9b06-2985e9e151ca service nova] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-5387b3c2-d18c-4fef-b173-d8bb1b31c52d req-c04d3002-3626-477d-9b06-2985e9e151ca service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] No waiting events found dispatching network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:53 user nova-compute[74959]: WARNING nova.compute.manager [req-5387b3c2-d18c-4fef-b173-d8bb1b31c52d req-c04d3002-3626-477d-9b06-2985e9e151ca service nova] [instance: dc9885ed-08ef-484c-89f6-97e4320217bc] Received unexpected event network-vif-plugged-27d08f4d-04eb-4dcd-ab2f-a5f730917f09 for instance with vm_state deleted and task_state None.
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.607s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:53 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Deleted allocations for instance dc9885ed-08ef-484c-89f6-97e4320217bc
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-b3cefa2c-6978-43b1-858f-d2839fc1a040 req-1b20d865-306f-4c21-b8f1-55f264e462a8 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b3cefa2c-6978-43b1-858f-d2839fc1a040 req-1b20d865-306f-4c21-b8f1-55f264e462a8 service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b3cefa2c-6978-43b1-858f-d2839fc1a040 req-1b20d865-306f-4c21-b8f1-55f264e462a8 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b3cefa2c-6978-43b1-858f-d2839fc1a040 req-1b20d865-306f-4c21-b8f1-55f264e462a8 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-b3cefa2c-6978-43b1-858f-d2839fc1a040 req-1b20d865-306f-4c21-b8f1-55f264e462a8 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:53 user nova-compute[74959]: WARNING nova.compute.manager [req-b3cefa2c-6978-43b1-858f-d2839fc1a040 req-1b20d865-306f-4c21-b8f1-55f264e462a8 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state building and task_state spawning.
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6e50d7f3-6d22-4e18-8954-4fa8209493ef tempest-AttachVolumeTestJSON-803300239 tempest-AttachVolumeTestJSON-803300239-project-member] Lock "dc9885ed-08ef-484c-89f6-97e4320217bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.205s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:12:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance spawned successfully.
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c0deb22b-ec7d-4cd4-a7a8-ff4f1ba89a59 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:54 user nova-compute[74959]: INFO nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:54 user nova-compute[74959]: INFO nova.compute.manager [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Took 9.82 seconds to build instance.
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be9e343c-d3f7-41df-86ad-065fa46bc778 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.929s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:12:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7513MB free_disk=24.901371002197266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 16ec5cae-3d8c-427b-a117-e0b8be34be5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 97925529-42d3-45de-af1b-be5df85c70e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 4645bea5-5301-4394-9ad8-0bc352a99dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:56 user nova-compute[74959]: INFO nova.compute.manager [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Rescuing
Nov 28 23:12:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquired lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:12:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Updating instance_info_cache with network_info: [{"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Releasing lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-17318887-68d0-463f-9837-83a665c3cfd5 req-30924071-6a43-43ac-9979-206258c8c3d8 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-17318887-68d0-463f-9837-83a665c3cfd5 req-30924071-6a43-43ac-9979-206258c8c3d8 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-17318887-68d0-463f-9837-83a665c3cfd5 req-30924071-6a43-43ac-9979-206258c8c3d8 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-17318887-68d0-463f-9837-83a665c3cfd5 req-30924071-6a43-43ac-9979-206258c8c3d8 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-17318887-68d0-463f-9837-83a665c3cfd5 req-30924071-6a43-43ac-9979-206258c8c3d8 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:57 user nova-compute[74959]: WARNING nova.compute.manager [req-17318887-68d0-463f-9837-83a665c3cfd5 req-30924071-6a43-43ac-9979-206258c8c3d8 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state active and task_state rescuing.
Nov 28 23:12:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:12:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance destroyed successfully.
Nov 28 23:12:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Attempting a stable device rescue
Nov 28 23:12:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74959) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 23:12:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance directory exists: not creating {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 23:12:58 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Creating image(s)
Nov 28 23:12:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "/opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "/opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "/opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:12:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "4a5224592be1001c0bd9d7655b4409e4df3c5f49" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "4a5224592be1001c0bd9d7655b4409e4df3c5f49" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49.part --force-share --output=json" returned: 0 in 0.212s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG nova.virt.images [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] aae3c338-71f0-4b74-b01a-51c4b0b4ed80 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49.part /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-55d53a75-9b86-4c07-b4f7-32b9c73c5a35 req-d29126d7-a969-4a33-baeb-424edbdb4c54 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-55d53a75-9b86-4c07-b4f7-32b9c73c5a35 req-d29126d7-a969-4a33-baeb-424edbdb4c54 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-55d53a75-9b86-4c07-b4f7-32b9c73c5a35 req-d29126d7-a969-4a33-baeb-424edbdb4c54 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-55d53a75-9b86-4c07-b4f7-32b9c73c5a35 req-d29126d7-a969-4a33-baeb-424edbdb4c54 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:12:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-55d53a75-9b86-4c07-b4f7-32b9c73c5a35 req-d29126d7-a969-4a33-baeb-424edbdb4c54 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:12:59 user nova-compute[74959]: WARNING nova.compute.manager [req-55d53a75-9b86-4c07-b4f7-32b9c73c5a35 req-d29126d7-a969-4a33-baeb-424edbdb4c54 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state active and task_state rescuing.
Nov 28 23:12:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49.part /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49.converted" returned: 0 in 0.279s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-d5e7c77b-990f-4485-9523-639ccfad969c req-2e405b9d-1f4b-4403-a3a6-54c15e0b91fc service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-changed-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-d5e7c77b-990f-4485-9523-639ccfad969c req-2e405b9d-1f4b-4403-a3a6-54c15e0b91fc service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Refreshing instance network info cache due to event network-changed-cfe2d164-f283-4339-a4ea-8732b732ce64. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5e7c77b-990f-4485-9523-639ccfad969c req-2e405b9d-1f4b-4403-a3a6-54c15e0b91fc service nova] Acquiring lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5e7c77b-990f-4485-9523-639ccfad969c req-2e405b9d-1f4b-4403-a3a6-54c15e0b91fc service nova] Acquired lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.network.neutron [req-d5e7c77b-990f-4485-9523-639ccfad969c req-2e405b9d-1f4b-4403-a3a6-54c15e0b91fc service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Refreshing network info cache for port cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "4a5224592be1001c0bd9d7655b4409e4df3c5f49" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.830s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "4a5224592be1001c0bd9d7655b4409e4df3c5f49" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "4a5224592be1001c0bd9d7655b4409e4df3c5f49" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49 --force-share --output=json" returned: 0 in 0.221s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49,backing_fmt=raw /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.rescue {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49,backing_fmt=raw /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.rescue" returned: 0 in 0.074s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "4a5224592be1001c0bd9d7655b4409e4df3c5f49" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'migration_context' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<16ec5cae-3d8c-427b-a117-e0b8be34be5f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Start _get_guest_xml network_info=[{"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "vif_mac": "fa:16:3e:66:32:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aae3c338-71f0-4b74-b01a-51c4b0b4ed80', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiZhgvEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '16ec5cae-3d8c-427b-a117-e0b8be34be5f', 'attached_at': '', 'detached_at': '', 'volume_id': '584501bf-b59a-43fd-ab2a-5dddfb514f49', 'serial': '584501bf-b59a-43fd-ab2a-5dddfb514f49'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '60e76f81-4b9c-42d5-aff2-c2d346464332', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'resources' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<16ec5cae-3d8c-427b-a117-e0b8be34be5f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'numa_topology' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<16ec5cae-3d8c-427b-a117-e0b8be34be5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:13:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'flavor' on Instance uuid 97925529-42d3-45de-af1b-be5df85c70e3 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.objects.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<16ec5cae-3d8c-427b-a117-e0b8be34be5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiZhgvEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:13:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:13:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:13:00 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[db964a3e-c2c2-4a42-b7dc-873065c706c5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NiZhgvEl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 23:13:00 user nova-compute[74959]: node.name = iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:13:00 user nova-compute[74959]: node.tpgt = -1
Nov 28 23:13:00 user nova-compute[74959]: node.startup = automatic
Nov 28 23:13:00 user nova-compute[74959]: node.leading_login = No
Nov 28 23:13:00 user nova-compute[74959]: iface.iscsi_ifacename = default
Nov 28 23:13:00 user nova-compute[74959]: iface.net_ifacename = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.ipaddress = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.prefix_len = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.hwaddress = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.transport_name = tcp
Nov 28 23:13:00 user nova-compute[74959]: iface.initiatorname = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.state = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.vlan_id = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.vlan_priority = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.vlan_state = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.iface_num = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.mtu = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.port = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.bootproto = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.subnet_mask = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.gateway = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.dhcp_alt_client_id = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.dhcp_dns = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.dhcp_learn_iqn = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.dhcp_vendor_id_state = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.dhcp_vendor_id = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.dhcp_slp_da = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.fragmentation = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.gratuitous_arp = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.incoming_forwarding = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.tos_state = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.tos = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.ttl = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.delayed_ack = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.tcp_nagle = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.tcp_wsf_state = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.tcp_wsf = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.tcp_timer_scale = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.tcp_timestamp = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.redirect = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.def_task_mgmt_timeout = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.header_digest = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.data_digest = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.immediate_data = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.initial_r2t = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.data_seq_inorder = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.data_pdu_inorder = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.erl = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.max_receive_data_len = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.first_burst_len = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.max_outstanding_r2t = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.max_burst_len = 0
Nov 28 23:13:00 user nova-compute[74959]: iface.chap_auth = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.bidi_chap = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.strict_login_compliance = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.discovery_auth = <empty>
Nov 28 23:13:00 user nova-compute[74959]: iface.discovery_logout = <empty>
Nov 28 23:13:00 user nova-compute[74959]: node.discovery_address = <empty>
Nov 28 23:13:00 user nova-compute[74959]: node.discovery_port = 0
Nov 28 23:13:00 user nova-compute[74959]: node.discovery_type = static
Nov 28 23:13:00 user nova-compute[74959]: node.session.initial_cmdsn = 0
Nov 28 23:13:00 user nova-compute[74959]: node.session.initial_login_retry_max = 8
Nov 28 23:13:00 user nova-compute[74959]: node.session.xmit_thread_priority = -20
Nov 28 23:13:00 user nova-compute[74959]: node.session.cmds_max = 128
Nov 28 23:13:00 user nova-compute[74959]: node.session.queue_depth = 32
Nov 28 23:13:00 user nova-compute[74959]: node.session.nr_sessions = 1
Nov 28 23:13:00 user nova-compute[74959]: node.session.auth.authmethod = CHAP
Nov 28 23:13:00 user nova-compute[74959]: node.session.auth.username = NiZhgvEl
Nov 28 23:13:00 user nova-compute[74959]: node.session.auth.password = ***
Nov 28 23:13:00 user nova-compute[74959]: node.session.auth.username_in = <empty>
Nov 28 23:13:00 user nova-compute[74959]: node.session.auth.password_in = <empty>
Nov 28 23:13:00 user nova-compute[74959]: node.session.auth.chap_algs = MD5
Nov 28 23:13:00 user nova-compute[74959]: node.session.timeo.replacement_timeout = 120
Nov 28 23:13:00 user nova-compute[74959]: node.session.err_timeo.abort_timeout = 15
Nov 28 23:13:00 user nova-compute[74959]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 23:13:00 user nova-compute[74959]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 23:13:00 user nova-compute[74959]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.FastAbort = Yes
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.InitialR2T = No
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.ImmediateData = Yes
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.MaxConnections = 1
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 23:13:00 user nova-compute[74959]: node.session.iscsi.ERL = 0
Nov 28 23:13:00 user nova-compute[74959]: node.session.scan = manual
Nov 28 23:13:00 user nova-compute[74959]: node.session.reopen_max = 0
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].address = 172.16.0.220
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].port = 3260
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].startup = manual
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].tcp.window_size = 524288
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].tcp.type_of_service = 0
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].timeo.logout_timeout = 15
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].timeo.login_timeout = 15
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].timeo.auth_timeout = 45
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].iscsi.DataDigest = None
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].iscsi.IFMarker = No
Nov 28 23:13:00 user nova-compute[74959]: node.conn[0].iscsi.OFMarker = No
Nov 28 23:13:00 user nova-compute[74959]: # END RECORD
Nov 28 23:13:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3d5cb7-7848-4b27-9b9a-8cd815b67d2e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c5be14-2b99-4c56-9ce4-fd9c8777e6d3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiZhgvEl {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.network.neutron [req-d5e7c77b-990f-4485-9523-639ccfad969c req-2e405b9d-1f4b-4403-a3a6-54c15e0b91fc service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updated VIF entry in instance network info cache for port cfe2d164-f283-4339-a4ea-8732b732ce64. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.network.neutron [req-d5e7c77b-990f-4485-9523-639ccfad969c req-2e405b9d-1f4b-4403-a3a6-54c15e0b91fc service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updating instance_info_cache with network_info: [{"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiZhgvEl" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b116035-1cd8-4973-9eec-977e4112f1d2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NiZhgvEl'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d5e7c77b-990f-4485-9523-639ccfad969c req-2e405b9d-1f4b-4403-a3a6-54c15e0b91fc service nova] Releasing lock "refresh_cache-97925529-42d3-45de-af1b-be5df85c70e3" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28ab7e2-af62-424e-9092-58ceb17087e3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d959f4-83f3-4f49-b25f-f65f51fd13ce]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:00 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:00 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:00 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:00 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:00 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:00 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] HCTL ('35', '0', '0', 0) found on session 32 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe6a28-0804-4ea1-b4ac-7231fa174bd3]: (4, ('0 0 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Searching for a device in session 32 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiZhgvEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '23663646362626164', 'path': '/dev/sdd'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:13:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663646362626164', 'path': '/dev/sdd'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:11:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-246858674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-246858674',id=31,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-90m40xs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:11:26Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=16ec5cae-3d8c-427b-a117-e0b8be34be5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "vif_mac": "fa:16:3e:66:32:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "vif_mac": "fa:16:3e:66:32:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:32:08,bridge_name='br-int',has_traffic_filtering=True,id=47fc4ac0-57b6-463f-b77d-daa68b8abdeb,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc4ac0-57') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'pci_devices' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:01 user nova-compute[74959]: INFO nova.compute.manager [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Attaching volume 983a6944-8ac4-4719-a4c4-210f07cc0d28 to /dev/vdb
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.objects.base [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Object Instance<16ec5cae-3d8c-427b-a117-e0b8be34be5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:13:01 user nova-compute[74959]:   <uuid>16ec5cae-3d8c-427b-a117-e0b8be34be5f</uuid>
Nov 28 23:13:01 user nova-compute[74959]:   <name>instance-0000001f</name>
Nov 28 23:13:01 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:13:01 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:13:01 user nova-compute[74959]:   <metadata>
Nov 28 23:13:01 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:13:01 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:13:01 user nova-compute[74959]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-246858674</nova:name>
Nov 28 23:13:01 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:13:00</nova:creationTime>
Nov 28 23:13:01 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:13:01 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:13:01 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:13:01 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:13:01 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:13:01 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:13:01 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:13:01 user nova-compute[74959]:       <nova:owner>
Nov 28 23:13:01 user nova-compute[74959]:         <nova:user uuid="5a8d218abbe14f27b754f1fffd9553f8">tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member</nova:user>
Nov 28 23:13:01 user nova-compute[74959]:         <nova:project uuid="8da22f0050e34c9b9a7658f16c08f28b">tempest-ServerBootFromVolumeStableRescueTest-1156029205</nova:project>
Nov 28 23:13:01 user nova-compute[74959]:       </nova:owner>
Nov 28 23:13:01 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:13:01 user nova-compute[74959]:       <nova:ports>
Nov 28 23:13:01 user nova-compute[74959]:         <nova:port uuid="47fc4ac0-57b6-463f-b77d-daa68b8abdeb">
Nov 28 23:13:01 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 23:13:01 user nova-compute[74959]:         </nova:port>
Nov 28 23:13:01 user nova-compute[74959]:       </nova:ports>
Nov 28 23:13:01 user nova-compute[74959]:     </nova:instance>
Nov 28 23:13:01 user nova-compute[74959]:   </metadata>
Nov 28 23:13:01 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:13:01 user nova-compute[74959]:     <system>
Nov 28 23:13:01 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:13:01 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:13:01 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:13:01 user nova-compute[74959]:       <entry name="serial">16ec5cae-3d8c-427b-a117-e0b8be34be5f</entry>
Nov 28 23:13:01 user nova-compute[74959]:       <entry name="uuid">16ec5cae-3d8c-427b-a117-e0b8be34be5f</entry>
Nov 28 23:13:01 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:13:01 user nova-compute[74959]:     </system>
Nov 28 23:13:01 user nova-compute[74959]:   </sysinfo>
Nov 28 23:13:01 user nova-compute[74959]:   <os>
Nov 28 23:13:01 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:13:01 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:13:01 user nova-compute[74959]:   </os>
Nov 28 23:13:01 user nova-compute[74959]:   <features>
Nov 28 23:13:01 user nova-compute[74959]:     <acpi/>
Nov 28 23:13:01 user nova-compute[74959]:     <apic/>
Nov 28 23:13:01 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:13:01 user nova-compute[74959]:   </features>
Nov 28 23:13:01 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:13:01 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:13:01 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:13:01 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:13:01 user nova-compute[74959]:   </clock>
Nov 28 23:13:01 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:13:01 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:13:01 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:13:01 user nova-compute[74959]:   </cpu>
Nov 28 23:13:01 user nova-compute[74959]:   <devices>
Nov 28 23:13:01 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:13:01 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:13:01 user nova-compute[74959]:       <source dev="/dev/sdd"/>
Nov 28 23:13:01 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:13:01 user nova-compute[74959]:       <serial>584501bf-b59a-43fd-ab2a-5dddfb514f49</serial>
Nov 28 23:13:01 user nova-compute[74959]:     </disk>
Nov 28 23:13:01 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:13:01 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:13:01 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.rescue"/>
Nov 28 23:13:01 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:13:01 user nova-compute[74959]:       <boot order="1"/>
Nov 28 23:13:01 user nova-compute[74959]:     </disk>
Nov 28 23:13:01 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:13:01 user nova-compute[74959]:       <mac address="fa:16:3e:66:32:08"/>
Nov 28 23:13:01 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:13:01 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:13:01 user nova-compute[74959]:       <target dev="tap47fc4ac0-57"/>
Nov 28 23:13:01 user nova-compute[74959]:     </interface>
Nov 28 23:13:01 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:13:01 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/console.log" append="off"/>
Nov 28 23:13:01 user nova-compute[74959]:     </serial>
Nov 28 23:13:01 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:13:01 user nova-compute[74959]:     <video>
Nov 28 23:13:01 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:13:01 user nova-compute[74959]:     </video>
Nov 28 23:13:01 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:13:01 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:13:01 user nova-compute[74959]:     </rng>
Nov 28 23:13:01 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:13:01 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:13:01 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:13:01 user nova-compute[74959]:     </memballoon>
Nov 28 23:13:01 user nova-compute[74959]:   </devices>
Nov 28 23:13:01 user nova-compute[74959]: </domain>
Nov 28 23:13:01 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:13:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance destroyed successfully.
Nov 28 23:13:01 user nova-compute[74959]: DEBUG os_brick.utils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[05311d40-9d25-4496-9fd8-a44f93f02a6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] No VIF found with MAC fa:16:3e:66:32:08, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf8257b-b6ba-4d06-9fa0-2c2e119c7169]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2269f9-cb28-4bc3-861f-69828409e12d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4007c1cd-f3b8-4956-ad45-4dec29172e47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:13:01 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:13:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc2ce47-c0f5-43c9-ba24-3d0b5919f909]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG os_brick.utils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updating existing volume attachment record: a79e5965-081c-4022-a9a9-cb3199c3e35c {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:13:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-21b3b69d-b6a2-48a3-a728-a46aac0c4320 req-0325bafd-f35d-4200-8b30-968b9bc7748d service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21b3b69d-b6a2-48a3-a728-a46aac0c4320 req-0325bafd-f35d-4200-8b30-968b9bc7748d service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21b3b69d-b6a2-48a3-a728-a46aac0c4320 req-0325bafd-f35d-4200-8b30-968b9bc7748d service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21b3b69d-b6a2-48a3-a728-a46aac0c4320 req-0325bafd-f35d-4200-8b30-968b9bc7748d service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-21b3b69d-b6a2-48a3-a728-a46aac0c4320 req-0325bafd-f35d-4200-8b30-968b9bc7748d service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:13:02 user nova-compute[74959]: WARNING nova.compute.manager [req-21b3b69d-b6a2-48a3-a728-a46aac0c4320 req-0325bafd-f35d-4200-8b30-968b9bc7748d service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state active and task_state rescuing.
Nov 28 23:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-110520f1-92b3-4b72-9eb0-34209c44edd2 req-888ab4d2-a059-4c74-b2d0-644a516e9103 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-110520f1-92b3-4b72-9eb0-34209c44edd2 req-888ab4d2-a059-4c74-b2d0-644a516e9103 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-110520f1-92b3-4b72-9eb0-34209c44edd2 req-888ab4d2-a059-4c74-b2d0-644a516e9103 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-110520f1-92b3-4b72-9eb0-34209c44edd2 req-888ab4d2-a059-4c74-b2d0-644a516e9103 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-110520f1-92b3-4b72-9eb0-34209c44edd2 req-888ab4d2-a059-4c74-b2d0-644a516e9103 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:13:04 user nova-compute[74959]: WARNING nova.compute.manager [req-110520f1-92b3-4b72-9eb0-34209c44edd2 req-888ab4d2-a059-4c74-b2d0-644a516e9103 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state active and task_state rescuing.
Nov 28 23:13:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e9326cdd-ce34-41e7-afd4-a9c95df64f2f tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:13:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcuwMtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:13:09 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:13:09 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:13:09 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[570bbefd-a823-4810-879a-61c7e1ac5671]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:13:09 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e641061-9fce-4d93-93db-d319e0adb7f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28] added
Nov 28 23:13:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ef83d-d474-4637-a939-c7ab5e00a535]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f4ed28-c3cb-495f-a0b3-f9befaf11aa2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcuwMtvV {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcuwMtvV" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49d882c-d160-4dc3-aab6-180a85056e06]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RcuwMtvV'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e75a51b-577f-4c0b-960b-38810ab30dc3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[144c3e9c-9c19-477f-8347-e6aa01eeb6f8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[19925dbb-5c66-4bb6-9761-9f2576964be0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260]
Nov 28 23:13:09 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260] successful.
Nov 28 23:13:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a2e35d-3694-4e24-9b51-b530d938ab19]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25750b9-5e2c-42c7-a255-084ddee84ea8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:13:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[987b405c-e881-461c-bdb8-8391cc058be5]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:13:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcuwMtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "a73da531-b1b4-4655-9511-ca0c1958acd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:13:10 user nova-compute[74959]: INFO nova.compute.claims [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Claim successful on node user
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23231626534633666', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231626534633666', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:13:10 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.objects.instance [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'flavor' on Instance uuid 97925529-42d3-45de-af1b-be5df85c70e3 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.policy [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba7d09ce239f44509d5c41a81fb422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e0f48d51e48df8a0061cb76139617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:13:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:13:10 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:13:10 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:13:10 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:13:10 user nova-compute[74959]:   <serial>983a6944-8ac4-4719-a4c4-210f07cc0d28</serial>
Nov 28 23:13:10 user nova-compute[74959]: </disk>
Nov 28 23:13:10 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:13:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Creating image(s)
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "/opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "/opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "/opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No VIF found with MAC fa:16:3e:49:d5:64, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.network.neutron [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Successfully created port: b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.225s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk 1073741824" returned: 0 in 0.062s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-2947c2f7-a421-4b23-922a-573c6935f38c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.663s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Cannot resize image /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Ensure instance console log exists: /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Successfully updated port: b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "refresh_cache-a73da531-b1b4-4655-9511-ca0c1958acd9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquired lock "refresh_cache-a73da531-b1b4-4655-9511-ca0c1958acd9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-10a0d426-c8e9-43d1-92b9-b79ea35d34ba req-3a657fc4-71b2-4dd5-bf48-66c51c2387f7 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received event network-changed-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-10a0d426-c8e9-43d1-92b9-b79ea35d34ba req-3a657fc4-71b2-4dd5-bf48-66c51c2387f7 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Refreshing instance network info cache due to event network-changed-b1350eea-df12-413f-91d2-051310d9b313. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-10a0d426-c8e9-43d1-92b9-b79ea35d34ba req-3a657fc4-71b2-4dd5-bf48-66c51c2387f7 service nova] Acquiring lock "refresh_cache-a73da531-b1b4-4655-9511-ca0c1958acd9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Updating instance_info_cache with network_info: [{"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Releasing lock "refresh_cache-a73da531-b1b4-4655-9511-ca0c1958acd9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Instance network_info: |[{"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-10a0d426-c8e9-43d1-92b9-b79ea35d34ba req-3a657fc4-71b2-4dd5-bf48-66c51c2387f7 service nova] Acquired lock "refresh_cache-a73da531-b1b4-4655-9511-ca0c1958acd9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-10a0d426-c8e9-43d1-92b9-b79ea35d34ba req-3a657fc4-71b2-4dd5-bf48-66c51c2387f7 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Refreshing network info cache for port b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Start _get_guest_xml network_info=[{"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:13:12 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:13:12 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-752507818',display_name='tempest-VolumesActionsTest-instance-752507818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-752507818',id=34,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e30e0f48d51e48df8a0061cb76139617',ramdisk_id='',reservation_id='r-8d0lhh0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1720378458',owner_user_name='tempest-VolumesActionsTest-1720378458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:13:11Z,user_data=None,user_id='ba7d09ce239f44509d5c41a81fb422e0',uuid=a73da531-b1b4-4655-9511-ca0c1958acd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Converting VIF {"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b1350eea-df12-413f-91d2-051310d9b313,network=Network(a9ea48c4-5317-441b-a6c3-e5cd1733fe5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1350eea-df') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.objects.instance [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lazy-loading 'pci_devices' on Instance uuid a73da531-b1b4-4655-9511-ca0c1958acd9 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:12 user nova-compute[74959]: INFO nova.compute.manager [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Rebuilding instance
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:13:12 user nova-compute[74959]:   <uuid>a73da531-b1b4-4655-9511-ca0c1958acd9</uuid>
Nov 28 23:13:12 user nova-compute[74959]:   <name>instance-00000022</name>
Nov 28 23:13:12 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:13:12 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:13:12 user nova-compute[74959]:   <metadata>
Nov 28 23:13:12 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:13:12 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:13:12 user nova-compute[74959]:       <nova:name>tempest-VolumesActionsTest-instance-752507818</nova:name>
Nov 28 23:13:12 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:13:12</nova:creationTime>
Nov 28 23:13:12 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:13:12 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:13:12 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:13:12 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:13:12 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:13:12 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:13:12 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:13:12 user nova-compute[74959]:       <nova:owner>
Nov 28 23:13:12 user nova-compute[74959]:         <nova:user uuid="ba7d09ce239f44509d5c41a81fb422e0">tempest-VolumesActionsTest-1720378458-project-member</nova:user>
Nov 28 23:13:12 user nova-compute[74959]:         <nova:project uuid="e30e0f48d51e48df8a0061cb76139617">tempest-VolumesActionsTest-1720378458</nova:project>
Nov 28 23:13:12 user nova-compute[74959]:       </nova:owner>
Nov 28 23:13:12 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:13:12 user nova-compute[74959]:       <nova:ports>
Nov 28 23:13:12 user nova-compute[74959]:         <nova:port uuid="b1350eea-df12-413f-91d2-051310d9b313">
Nov 28 23:13:12 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 23:13:12 user nova-compute[74959]:         </nova:port>
Nov 28 23:13:12 user nova-compute[74959]:       </nova:ports>
Nov 28 23:13:12 user nova-compute[74959]:     </nova:instance>
Nov 28 23:13:12 user nova-compute[74959]:   </metadata>
Nov 28 23:13:12 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:13:12 user nova-compute[74959]:     <system>
Nov 28 23:13:12 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:13:12 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:13:12 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:13:12 user nova-compute[74959]:       <entry name="serial">a73da531-b1b4-4655-9511-ca0c1958acd9</entry>
Nov 28 23:13:12 user nova-compute[74959]:       <entry name="uuid">a73da531-b1b4-4655-9511-ca0c1958acd9</entry>
Nov 28 23:13:12 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:13:12 user nova-compute[74959]:     </system>
Nov 28 23:13:12 user nova-compute[74959]:   </sysinfo>
Nov 28 23:13:12 user nova-compute[74959]:   <os>
Nov 28 23:13:12 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:13:12 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:13:12 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:13:12 user nova-compute[74959]:   </os>
Nov 28 23:13:12 user nova-compute[74959]:   <features>
Nov 28 23:13:12 user nova-compute[74959]:     <acpi/>
Nov 28 23:13:12 user nova-compute[74959]:     <apic/>
Nov 28 23:13:12 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:13:12 user nova-compute[74959]:   </features>
Nov 28 23:13:12 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:13:12 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:13:12 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:13:12 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:13:12 user nova-compute[74959]:   </clock>
Nov 28 23:13:12 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:13:12 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:13:12 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:13:12 user nova-compute[74959]:   </cpu>
Nov 28 23:13:12 user nova-compute[74959]:   <devices>
Nov 28 23:13:12 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:13:12 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:13:12 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk"/>
Nov 28 23:13:12 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:13:12 user nova-compute[74959]:     </disk>
Nov 28 23:13:12 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:13:12 user nova-compute[74959]:       <mac address="fa:16:3e:65:a8:aa"/>
Nov 28 23:13:12 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:13:12 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:13:12 user nova-compute[74959]:       <target dev="tapb1350eea-df"/>
Nov 28 23:13:12 user nova-compute[74959]:     </interface>
Nov 28 23:13:12 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:13:12 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/console.log" append="off"/>
Nov 28 23:13:12 user nova-compute[74959]:     </serial>
Nov 28 23:13:12 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:13:12 user nova-compute[74959]:     <video>
Nov 28 23:13:12 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:13:12 user nova-compute[74959]:     </video>
Nov 28 23:13:12 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:13:12 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:13:12 user nova-compute[74959]:     </rng>
Nov 28 23:13:12 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:13:12 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:13:12 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:13:12 user nova-compute[74959]:     </memballoon>
Nov 28 23:13:12 user nova-compute[74959]:   </devices>
Nov 28 23:13:12 user nova-compute[74959]: </domain>
Nov 28 23:13:12 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-752507818',display_name='tempest-VolumesActionsTest-instance-752507818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-752507818',id=34,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e30e0f48d51e48df8a0061cb76139617',ramdisk_id='',reservation_id='r-8d0lhh0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1720378458',owner_user_name='tempest-VolumesActionsTest-1720378458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:13:11Z,user_data=None,user_id='ba7d09ce239f44509d5c41a81fb422e0',uuid=a73da531-b1b4-4655-9511-ca0c1958acd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Converting VIF {"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b1350eea-df12-413f-91d2-051310d9b313,network=Network(a9ea48c4-5317-441b-a6c3-e5cd1733fe5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1350eea-df') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG os_vif [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b1350eea-df12-413f-91d2-051310d9b313,network=Network(a9ea48c4-5317-441b-a6c3-e5cd1733fe5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1350eea-df') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aeca7c20-11ff-5186-914c-d2360885b30e', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1350eea-df, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1350eea-df, col_values=(('qos', UUID('aee31523-b262-4b29-9653-d6568bcbb354')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1350eea-df, col_values=(('external_ids', {'iface-id': 'b1350eea-df12-413f-91d2-051310d9b313', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:a8:aa', 'vm-uuid': 'a73da531-b1b4-4655-9511-ca0c1958acd9'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:12 user nova-compute[74959]: INFO os_vif [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b1350eea-df12-413f-91d2-051310d9b313,network=Network(a9ea48c4-5317-441b-a6c3-e5cd1733fe5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1350eea-df')
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] No VIF found with MAC fa:16:3e:65:a8:aa, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-10a0d426-c8e9-43d1-92b9-b79ea35d34ba req-3a657fc4-71b2-4dd5-bf48-66c51c2387f7 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Updated VIF entry in instance network info cache for port b1350eea-df12-413f-91d2-051310d9b313. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-10a0d426-c8e9-43d1-92b9-b79ea35d34ba req-3a657fc4-71b2-4dd5-bf48-66c51c2387f7 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Updating instance_info_cache with network_info: [{"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:13:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-10a0d426-c8e9-43d1-92b9-b79ea35d34ba req-3a657fc4-71b2-4dd5-bf48-66c51c2387f7 service nova] Releasing lock "refresh_cache-a73da531-b1b4-4655-9511-ca0c1958acd9" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:13:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance destroyed successfully.
Nov 28 23:13:14 user nova-compute[74959]: INFO nova.compute.manager [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Detaching volume 983a6944-8ac4-4719-a4c4-210f07cc0d28
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:13:14 user nova-compute[74959]: WARNING nova.compute.manager [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state active and task_state rebuilding.
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:13:14 user nova-compute[74959]: WARNING nova.compute.manager [req-749c6889-3f3f-4244-a600-13a40e979dce req-27253762-c92b-4c41-a4dd-d2db89efc362 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state active and task_state rebuilding.
Nov 28 23:13:14 user nova-compute[74959]: INFO nova.virt.block_device [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Attempting to driver detach volume 983a6944-8ac4-4719-a4c4-210f07cc0d28 from mountpoint /dev/vdb
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Attempting to detach device vdb from instance 97925529-42d3-45de-af1b-be5df85c70e3 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:13:14 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:13:14 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:13:14 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:13:14 user nova-compute[74959]:   <serial>983a6944-8ac4-4719-a4c4-210f07cc0d28</serial>
Nov 28 23:13:14 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:13:14 user nova-compute[74959]: </disk>
Nov 28 23:13:14 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:13:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully detached device vdb from instance 97925529-42d3-45de-af1b-be5df85c70e3 from the persistent domain config.
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcuwMtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:13:14 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ffc1ab-9799-4044-a634-cb3c5fdf8382]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:13:14 user nova-compute[74959]: No targets found.
Nov 28 23:13:14 user nova-compute[74959]: iSNS:
Nov 28 23:13:14 user nova-compute[74959]: No targets found.
Nov 28 23:13:14 user nova-compute[74959]: STATIC:
Nov 28 23:13:14 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28
Nov 28 23:13:14 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:14 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:14 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:13:14 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:14 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:14 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:13:14 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:14 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:14 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:13:14 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:14 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:14 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5
Nov 28 23:13:14 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:14 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:14 user nova-compute[74959]: FIRMWARE:
Nov 28 23:13:14 user nova-compute[74959]: No targets found.
Nov 28 23:13:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:13:14 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:13:14 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[affe6006-5ac8-4bb7-8fce-0fcd1ceafa1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f02a0-6402-434d-aaf6-5491ac6fb3b0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:13:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef47a76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b11919-2eb5-41bb-b97d-f771f1cd3049]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed210c1-5195-4f85-b3b5-d2469f68c229]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[25df165d-ea81-4584-b27c-41aca59c6471]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eed927-3ef4-4bff-babd-d94f3012aab2]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd0c621-24f4-496a-9860-504c2d3e53a2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f706a0bf-117f-4b44-b8bc-f4fc804b7300]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260]
Nov 28 23:13:14 user nova-compute[74959]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260] successful.
Nov 28 23:13:14 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4122e88-79d3-4d38-a755-14f5d39b2386]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== disconnect_volume: return (389ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-e62d82cb-10e8-46d6-9536-cfc7cf207a18 req-8c3c8cbe-4c62-478b-ab7b-ea6900f6af36 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received event network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e62d82cb-10e8-46d6-9536-cfc7cf207a18 req-8c3c8cbe-4c62-478b-ab7b-ea6900f6af36 service nova] Acquiring lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e62d82cb-10e8-46d6-9536-cfc7cf207a18 req-8c3c8cbe-4c62-478b-ab7b-ea6900f6af36 service nova] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e62d82cb-10e8-46d6-9536-cfc7cf207a18 req-8c3c8cbe-4c62-478b-ab7b-ea6900f6af36 service nova] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-e62d82cb-10e8-46d6-9536-cfc7cf207a18 req-8c3c8cbe-4c62-478b-ab7b-ea6900f6af36 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] No waiting events found dispatching network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:13:14 user nova-compute[74959]: WARNING nova.compute.manager [req-e62d82cb-10e8-46d6-9536-cfc7cf207a18 req-8c3c8cbe-4c62-478b-ab7b-ea6900f6af36 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received unexpected event network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 for instance with vm_state building and task_state spawning.
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance destroyed successfully.
Nov 28 23:13:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1413169235',display_name='tempest-ServerActionsTestOtherA-server-79963409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1413169235',id=32,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdIoqmkvBna6Fv6ppa7qEeS6l1KBSr/ZyBTQ7THMwZctuzylt05K45+gXmZE4p1MmHrojrazd4igdKhE8hysq24F9wXqR6aGP7N8BCzHsubCBOyMJOIqKdYEs5cpfbyHw==',key_name='tempest-keypair-781582706',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-oykyumb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=97925529-42d3-45de-af1b-be5df85c70e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_vif [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfe2d164-f2, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e206ee43-c3d5-4b11-b262-e670d1236280) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:15 user nova-compute[74959]: INFO os_vif [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2')
Nov 28 23:13:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcuwMtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:13:15 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c8e04-52bf-491f-8b3b-3dffbbb987bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:13:15 user nova-compute[74959]: No targets found.
Nov 28 23:13:15 user nova-compute[74959]: iSNS:
Nov 28 23:13:15 user nova-compute[74959]: No targets found.
Nov 28 23:13:15 user nova-compute[74959]: STATIC:
Nov 28 23:13:15 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:13:15 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:15 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:15 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:13:15 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:15 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:15 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:13:15 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:15 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:15 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5
Nov 28 23:13:15 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:13:15 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:13:15 user nova-compute[74959]: FIRMWARE:
Nov 28 23:13:15 user nova-compute[74959]: No targets found.
Nov 28 23:13:15 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:13:15 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:13:15 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eab488e-22c8-4df8-9982-3775e0a6cc74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[29843306-6d2e-4c9a-949f-4f79d2922506]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:15 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:15 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:15 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:15 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:15 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:15 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:15 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:15 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc7d3d00>, {}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Disconnecting from: [] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== disconnect_volume: return (78ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:13:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Deleting instance files /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3_del
Nov 28 23:13:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Deletion of /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3_del complete
Nov 28 23:13:15 user nova-compute[74959]: INFO nova.virt.block_device [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Booting with volume 983a6944-8ac4-4719-a4c4-210f07cc0d28 at /dev/vdb
Nov 28 23:13:15 user nova-compute[74959]: DEBUG os_brick.utils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7582754b-3e01-4e1b-ad3b-b9c89fdb5613]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d11495e-0b78-4991-8b50-e26ed716bf8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[07827c8f-3a24-40ec-bd92-139caa457c70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f721fb7-9344-4448-aef3-7d6dd8b03e56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:13:16 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e9331-c134-4fef-861c-fbfe77accd62]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG os_brick.utils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updating existing volume attachment record: c0092d4b-66eb-4530-b74e-973fdd63d06d {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:13:16 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Instance spawned successfully.
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:16 user nova-compute[74959]: INFO nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-18d99d19-d321-4f79-90ef-208462790a46 req-bfbf32b0-fe0e-4642-ae2f-9d8ccda2ea6d service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received event network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18d99d19-d321-4f79-90ef-208462790a46 req-bfbf32b0-fe0e-4642-ae2f-9d8ccda2ea6d service nova] Acquiring lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18d99d19-d321-4f79-90ef-208462790a46 req-bfbf32b0-fe0e-4642-ae2f-9d8ccda2ea6d service nova] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18d99d19-d321-4f79-90ef-208462790a46 req-bfbf32b0-fe0e-4642-ae2f-9d8ccda2ea6d service nova] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-18d99d19-d321-4f79-90ef-208462790a46 req-bfbf32b0-fe0e-4642-ae2f-9d8ccda2ea6d service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] No waiting events found dispatching network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:13:16 user nova-compute[74959]: WARNING nova.compute.manager [req-18d99d19-d321-4f79-90ef-208462790a46 req-bfbf32b0-fe0e-4642-ae2f-9d8ccda2ea6d service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received unexpected event network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 for instance with vm_state building and task_state spawning.
Nov 28 23:13:17 user nova-compute[74959]: INFO nova.compute.manager [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Took 6.71 seconds to build instance.
Nov 28 23:13:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-991e64b4-c370-4b35-8b18-4c4f7b43fc6a tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.822s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:13:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Creating image(s)
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.228s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk 1073741824" returned: 0 in 0.050s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.213s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Cannot resize image /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Ensure instance console log exists: /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Start _get_guest_xml network_info=[{"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcuwMtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97925529-42d3-45de-af1b-be5df85c70e3', 'attached_at': '', 'detached_at': '', 'volume_id': '983a6944-8ac4-4719-a4c4-210f07cc0d28', 'serial': '983a6944-8ac4-4719-a4c4-210f07cc0d28'}, 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'c0092d4b-66eb-4530-b74e-973fdd63d06d', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:13:25 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 23:13:25 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97925529-42d3-45de-af1b-be5df85c70e3 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcuwMtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:13:25 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:13:25 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:13:25 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[316c16ac-701f-40c2-96ba-3d5a452184b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:13:25 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3734c8a3-8a17-4cf8-b16a-27e82975c99b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28] added
Nov 28 23:13:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfefc225-a845-495b-a1d6-2e8f0176151c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547d611-8330-4894-b1f7-ccdeec9457b3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcuwMtvV {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcuwMtvV" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8560b34f-bb48-496f-a2ae-bce1395d4c43]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RcuwMtvV'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e26622-fc2e-408b-ac82-ada08c940322]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1191f8-4fa3-40ab-945b-b5cf862e59eb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca6a65c-ea2b-4939-b7b6-7cd816a43c29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260]
Nov 28 23:13:25 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260] successful.
Nov 28 23:13:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d22f4e3-b74c-4af9-a522-b1f797d0aa0e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b661e3c1-449a-4872-867e-95b38d36c672]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:13:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a66fd6-f202-4a4f-b639-7a0191963976]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcuwMtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:13:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23231626534633666', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231626534633666', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1413169235',display_name='tempest-ServerActionsTestOtherA-server-79963409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1413169235',id=32,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdIoqmkvBna6Fv6ppa7qEeS6l1KBSr/ZyBTQ7THMwZctuzylt05K45+gXmZE4p1MmHrojrazd4igdKhE8hysq24F9wXqR6aGP7N8BCzHsubCBOyMJOIqKdYEs5cpfbyHw==',key_name='tempest-keypair-781582706',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-oykyumb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=97925529-42d3-45de-af1b-be5df85c70e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:13:26 user nova-compute[74959]:   <uuid>97925529-42d3-45de-af1b-be5df85c70e3</uuid>
Nov 28 23:13:26 user nova-compute[74959]:   <name>instance-00000020</name>
Nov 28 23:13:26 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:13:26 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:13:26 user nova-compute[74959]:   <metadata>
Nov 28 23:13:26 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:13:26 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:13:26 user nova-compute[74959]:       <nova:name>tempest-ServerActionsTestOtherA-server-79963409</nova:name>
Nov 28 23:13:26 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:13:25</nova:creationTime>
Nov 28 23:13:26 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:13:26 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:13:26 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:13:26 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:13:26 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:13:26 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:13:26 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:13:26 user nova-compute[74959]:       <nova:owner>
Nov 28 23:13:26 user nova-compute[74959]:         <nova:user uuid="73af90e11a374c9cbf0a58db8410e245">tempest-ServerActionsTestOtherA-2143945835-project-member</nova:user>
Nov 28 23:13:26 user nova-compute[74959]:         <nova:project uuid="0ac0d1f399f040f98098e84ac875c1fd">tempest-ServerActionsTestOtherA-2143945835</nova:project>
Nov 28 23:13:26 user nova-compute[74959]:       </nova:owner>
Nov 28 23:13:26 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:13:26 user nova-compute[74959]:       <nova:ports>
Nov 28 23:13:26 user nova-compute[74959]:         <nova:port uuid="cfe2d164-f283-4339-a4ea-8732b732ce64">
Nov 28 23:13:26 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:13:26 user nova-compute[74959]:         </nova:port>
Nov 28 23:13:26 user nova-compute[74959]:       </nova:ports>
Nov 28 23:13:26 user nova-compute[74959]:     </nova:instance>
Nov 28 23:13:26 user nova-compute[74959]:   </metadata>
Nov 28 23:13:26 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:13:26 user nova-compute[74959]:     <system>
Nov 28 23:13:26 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:13:26 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:13:26 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:13:26 user nova-compute[74959]:       <entry name="serial">97925529-42d3-45de-af1b-be5df85c70e3</entry>
Nov 28 23:13:26 user nova-compute[74959]:       <entry name="uuid">97925529-42d3-45de-af1b-be5df85c70e3</entry>
Nov 28 23:13:26 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:13:26 user nova-compute[74959]:     </system>
Nov 28 23:13:26 user nova-compute[74959]:   </sysinfo>
Nov 28 23:13:26 user nova-compute[74959]:   <os>
Nov 28 23:13:26 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:13:26 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:13:26 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:13:26 user nova-compute[74959]:   </os>
Nov 28 23:13:26 user nova-compute[74959]:   <features>
Nov 28 23:13:26 user nova-compute[74959]:     <acpi/>
Nov 28 23:13:26 user nova-compute[74959]:     <apic/>
Nov 28 23:13:26 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:13:26 user nova-compute[74959]:   </features>
Nov 28 23:13:26 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:13:26 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:13:26 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:13:26 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:13:26 user nova-compute[74959]:   </clock>
Nov 28 23:13:26 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:13:26 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:13:26 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:13:26 user nova-compute[74959]:   </cpu>
Nov 28 23:13:26 user nova-compute[74959]:   <devices>
Nov 28 23:13:26 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:13:26 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:13:26 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk"/>
Nov 28 23:13:26 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:13:26 user nova-compute[74959]:     </disk>
Nov 28 23:13:26 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:13:26 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:13:26 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:13:26 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:13:26 user nova-compute[74959]:       <serial>983a6944-8ac4-4719-a4c4-210f07cc0d28</serial>
Nov 28 23:13:26 user nova-compute[74959]:     </disk>
Nov 28 23:13:26 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:13:26 user nova-compute[74959]:       <mac address="fa:16:3e:49:d5:64"/>
Nov 28 23:13:26 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:13:26 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:13:26 user nova-compute[74959]:       <target dev="tapcfe2d164-f2"/>
Nov 28 23:13:26 user nova-compute[74959]:     </interface>
Nov 28 23:13:26 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:13:26 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/console.log" append="off"/>
Nov 28 23:13:26 user nova-compute[74959]:     </serial>
Nov 28 23:13:26 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:13:26 user nova-compute[74959]:     <video>
Nov 28 23:13:26 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:13:26 user nova-compute[74959]:     </video>
Nov 28 23:13:26 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:13:26 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:13:26 user nova-compute[74959]:     </rng>
Nov 28 23:13:26 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:13:26 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:13:26 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:13:26 user nova-compute[74959]:     </memballoon>
Nov 28 23:13:26 user nova-compute[74959]:   </devices>
Nov 28 23:13:26 user nova-compute[74959]: </domain>
Nov 28 23:13:26 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1413169235',display_name='tempest-ServerActionsTestOtherA-server-79963409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1413169235',id=32,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdIoqmkvBna6Fv6ppa7qEeS6l1KBSr/ZyBTQ7THMwZctuzylt05K45+gXmZE4p1MmHrojrazd4igdKhE8hysq24F9wXqR6aGP7N8BCzHsubCBOyMJOIqKdYEs5cpfbyHw==',key_name='tempest-keypair-781582706',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-oykyumb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=97925529-42d3-45de-af1b-be5df85c70e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG os_vif [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3947396c-62eb-5929-ab65-dddbc00a0875', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfe2d164-f2, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfe2d164-f2, col_values=(('qos', UUID('28be5d53-8348-4226-bdd0-3de26c10ac0c')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfe2d164-f2, col_values=(('external_ids', {'iface-id': 'cfe2d164-f283-4339-a4ea-8732b732ce64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:d5:64', 'vm-uuid': '97925529-42d3-45de-af1b-be5df85c70e3'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:26 user nova-compute[74959]: INFO os_vif [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2')
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No VIF found with MAC fa:16:3e:49:d5:64, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:13:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-47cbcc75-01b1-4bb7-b2f3-15c8eae1acdf req-a39eb66e-3dc7-45c9-9038-32fb76846997 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-47cbcc75-01b1-4bb7-b2f3-15c8eae1acdf req-a39eb66e-3dc7-45c9-9038-32fb76846997 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-47cbcc75-01b1-4bb7-b2f3-15c8eae1acdf req-a39eb66e-3dc7-45c9-9038-32fb76846997 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-47cbcc75-01b1-4bb7-b2f3-15c8eae1acdf req-a39eb66e-3dc7-45c9-9038-32fb76846997 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-47cbcc75-01b1-4bb7-b2f3-15c8eae1acdf req-a39eb66e-3dc7-45c9-9038-32fb76846997 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:13:28 user nova-compute[74959]: WARNING nova.compute.manager [req-47cbcc75-01b1-4bb7-b2f3-15c8eae1acdf req-a39eb66e-3dc7-45c9-9038-32fb76846997 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 23:13:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:13:30 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance spawned successfully.
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-48e6b3af-58f2-4a37-8a76-119fa4b53743 req-b5f129d3-344b-4b79-a459-439a2db393c4 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-48e6b3af-58f2-4a37-8a76-119fa4b53743 req-b5f129d3-344b-4b79-a459-439a2db393c4 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-48e6b3af-58f2-4a37-8a76-119fa4b53743 req-b5f129d3-344b-4b79-a459-439a2db393c4 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-48e6b3af-58f2-4a37-8a76-119fa4b53743 req-b5f129d3-344b-4b79-a459-439a2db393c4 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-48e6b3af-58f2-4a37-8a76-119fa4b53743 req-b5f129d3-344b-4b79-a459-439a2db393c4 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:13:30 user nova-compute[74959]: WARNING nova.compute.manager [req-48e6b3af-58f2-4a37-8a76-119fa4b53743 req-b5f129d3-344b-4b79-a459-439a2db393c4 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 23:13:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74959) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 23:13:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb128abb-d44d-4b74-b7d1-5da4228b71a7 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:13:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:13:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:13:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:13:42 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:13:42 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:13:43 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updating instance_info_cache with network_info: [{"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:13:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-598c6a68-9826-4fc1-a6ee-17eafd5b14e8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:13:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:13:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-81293883-7728-4510-b6cf-3ca447905425 req-0f670841-639e-419b-a7fb-669b758c87fa service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-81293883-7728-4510-b6cf-3ca447905425 req-0f670841-639e-419b-a7fb-669b758c87fa service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing instance network info cache due to event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-81293883-7728-4510-b6cf-3ca447905425 req-0f670841-639e-419b-a7fb-669b758c87fa service nova] Acquiring lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-81293883-7728-4510-b6cf-3ca447905425 req-0f670841-639e-419b-a7fb-669b758c87fa service nova] Acquired lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG nova.network.neutron [req-81293883-7728-4510-b6cf-3ca447905425 req-0f670841-639e-419b-a7fb-669b758c87fa service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG nova.network.neutron [req-81293883-7728-4510-b6cf-3ca447905425 req-0f670841-639e-419b-a7fb-669b758c87fa service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updated VIF entry in instance network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG nova.network.neutron [req-81293883-7728-4510-b6cf-3ca447905425 req-0f670841-639e-419b-a7fb-669b758c87fa service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:13:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-81293883-7728-4510-b6cf-3ca447905425 req-0f670841-639e-419b-a7fb-669b758c87fa service nova] Releasing lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:13:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:47 user nova-compute[74959]: INFO nova.compute.manager [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Detaching volume 652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:13:47 user nova-compute[74959]: INFO nova.virt.block_device [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Attempting to driver detach volume 652ac64f-6454-4b76-b7de-19b2d70f4802 from mountpoint /dev/vdb
Nov 28 23:13:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Attempting to detach device vdb from instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:13:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:13:47 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:13:47 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:13:47 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:13:47 user nova-compute[74959]:   <serial>652ac64f-6454-4b76-b7de-19b2d70f4802</serial>
Nov 28 23:13:47 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 23:13:47 user nova-compute[74959]: </disk>
Nov 28 23:13:47 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:13:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully detached device vdb from instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e from the persistent domain config.
Nov 28 23:13:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:13:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:13:47 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:13:47 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:13:47 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:13:47 user nova-compute[74959]:   <serial>652ac64f-6454-4b76-b7de-19b2d70f4802</serial>
Nov 28 23:13:47 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 23:13:47 user nova-compute[74959]: </disk>
Nov 28 23:13:47 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:13:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:13:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-01aac2ff-88e3-490e-a5aa-3d3da78c1e32 req-40bb8468-df16-41c2-aa69-f057596fdd04 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:13:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-01aac2ff-88e3-490e-a5aa-3d3da78c1e32 req-40bb8468-df16-41c2-aa69-f057596fdd04 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing instance network info cache due to event network-changed-465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:13:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-01aac2ff-88e3-490e-a5aa-3d3da78c1e32 req-40bb8468-df16-41c2-aa69-f057596fdd04 service nova] Acquiring lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:13:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-01aac2ff-88e3-490e-a5aa-3d3da78c1e32 req-40bb8468-df16-41c2-aa69-f057596fdd04 service nova] Acquired lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:13:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-01aac2ff-88e3-490e-a5aa-3d3da78c1e32 req-40bb8468-df16-41c2-aa69-f057596fdd04 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Refreshing network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG nova.network.neutron [req-01aac2ff-88e3-490e-a5aa-3d3da78c1e32 req-40bb8468-df16-41c2-aa69-f057596fdd04 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updated VIF entry in instance network info cache for port 465c6e1b-9eb2-470e-8647-8b43d80e945a. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG nova.network.neutron [req-01aac2ff-88e3-490e-a5aa-3d3da78c1e32 req-40bb8468-df16-41c2-aa69-f057596fdd04 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [{"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-01aac2ff-88e3-490e-a5aa-3d3da78c1e32 req-40bb8468-df16-41c2-aa69-f057596fdd04 service nova] Releasing lock "refresh_cache-d4c21a2d-bc24-4c8d-9703-7aa61f62713e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:13:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:13:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:13:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7170MB free_disk=24.76184844970703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 16ec5cae-3d8c-427b-a117-e0b8be34be5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 97925529-42d3-45de-af1b-be5df85c70e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 4645bea5-5301-4394-9ad8-0bc352a99dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance a73da531-b1b4-4655-9511-ca0c1958acd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:13:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:13:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:13:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:13:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:13:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:13:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:13:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:13:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:13:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:08 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e is timed out.
Nov 28 23:14:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully detached device vdb from instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e from the live domain config.
Nov 28 23:14:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUvkWiXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:14:08 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2a858d-13bc-4d91-a854-c8759ec2b1d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:14:08 user nova-compute[74959]: No targets found.
Nov 28 23:14:08 user nova-compute[74959]: iSNS:
Nov 28 23:14:08 user nova-compute[74959]: No targets found.
Nov 28 23:14:08 user nova-compute[74959]: STATIC:
Nov 28 23:14:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28
Nov 28 23:14:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:14:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:14:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802
Nov 28 23:14:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:14:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:14:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:14:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:14:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:14:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:14:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:14:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:14:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5
Nov 28 23:14:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:14:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:14:08 user nova-compute[74959]: FIRMWARE:
Nov 28 23:14:08 user nova-compute[74959]: No targets found.
Nov 28 23:14:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:14:08 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:14:08 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[173c4243-9e85-44b1-9cdc-e507f81a0c57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3455d4ad-bb18-4f15-84b8-1f1cadabb949]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:14:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc5e9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802'): ({'sde'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Removing single pathed devices sde {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba16ad-75f2-4ff4-9cfa-3245ece60dad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[438230ba-d86b-49af-9d87-e8e1ae021f78]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flushing IO for device /dev/sde {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cb9d35-f649-432f-9901-2d9cdea00570]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[688c5ad2-245b-4ee3-be16-4dc5027709a3]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6557b-cee3-483c-a24f-ae76d05f11c5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d31a0-c795-4a02-9087-d6a1dcdd69f1]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260]
Nov 28 23:14:08 user nova-compute[74959]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802, portal: 172.16.0.220,3260] successful.
Nov 28 23:14:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652ac64f-6454-4b76-b7de-19b2d70f4802 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c71e2-06a1-46ff-a8cc-c97477cc4f39]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] <== disconnect_volume: return (341ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:14:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:14:09 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'flavor' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:14:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e91be640-738f-469f-9c07-7db5c5076626 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.041s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:14:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:14:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:14:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:14:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:14:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:14:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:14:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:14:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:14:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:14:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:14:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:14:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:14:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:34 user nova-compute[74959]: INFO nova.compute.manager [None req-3832a37c-949f-47c5-ad07-899c04ab6aa4 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Unrescuing
Nov 28 23:14:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3832a37c-949f-47c5-ad07-899c04ab6aa4 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:14:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3832a37c-949f-47c5-ad07-899c04ab6aa4 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquired lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:14:34 user nova-compute[74959]: DEBUG nova.network.neutron [None req-3832a37c-949f-47c5-ad07-899c04ab6aa4 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:14:34 user nova-compute[74959]: DEBUG nova.network.neutron [None req-3832a37c-949f-47c5-ad07-899c04ab6aa4 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating instance_info_cache with network_info: [{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3832a37c-949f-47c5-ad07-899c04ab6aa4 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Releasing lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3832a37c-949f-47c5-ad07-899c04ab6aa4 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'flavor' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-a84d44b1-9d2f-4ef9-b742-aa67211da89b req-cfa973b6-de1d-4497-818e-2e0aafd67cb7 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a84d44b1-9d2f-4ef9-b742-aa67211da89b req-cfa973b6-de1d-4497-818e-2e0aafd67cb7 service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a84d44b1-9d2f-4ef9-b742-aa67211da89b req-cfa973b6-de1d-4497-818e-2e0aafd67cb7 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a84d44b1-9d2f-4ef9-b742-aa67211da89b req-cfa973b6-de1d-4497-818e-2e0aafd67cb7 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-a84d44b1-9d2f-4ef9-b742-aa67211da89b req-cfa973b6-de1d-4497-818e-2e0aafd67cb7 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:35 user nova-compute[74959]: WARNING nova.compute.manager [req-a84d44b1-9d2f-4ef9-b742-aa67211da89b req-cfa973b6-de1d-4497-818e-2e0aafd67cb7 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-712924f7-1077-48b8-b02c-c4b5fc43f407 req-4623f7ca-2e45-45b5-a789-9678d4f6527b service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-changed-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-712924f7-1077-48b8-b02c-c4b5fc43f407 req-4623f7ca-2e45-45b5-a789-9678d4f6527b service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Refreshing instance network info cache due to event network-changed-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-712924f7-1077-48b8-b02c-c4b5fc43f407 req-4623f7ca-2e45-45b5-a789-9678d4f6527b service nova] Acquiring lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-712924f7-1077-48b8-b02c-c4b5fc43f407 req-4623f7ca-2e45-45b5-a789-9678d4f6527b service nova] Acquired lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.network.neutron [req-712924f7-1077-48b8-b02c-c4b5fc43f407 req-4623f7ca-2e45-45b5-a789-9678d4f6527b service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Refreshing network info cache for port bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:14:35 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance destroyed successfully.
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-7fc53415-0d96-4a22-9b3b-0d5ec0e8e3bb req-4f3d721c-b020-4ffe-8b55-22a81b07e5a7 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-changed-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-7fc53415-0d96-4a22-9b3b-0d5ec0e8e3bb req-4f3d721c-b020-4ffe-8b55-22a81b07e5a7 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Refreshing instance network info cache due to event network-changed-c897ce7f-6b41-4c61-9e90-56577c38cac7. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7fc53415-0d96-4a22-9b3b-0d5ec0e8e3bb req-4f3d721c-b020-4ffe-8b55-22a81b07e5a7 service nova] Acquiring lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7fc53415-0d96-4a22-9b3b-0d5ec0e8e3bb req-4f3d721c-b020-4ffe-8b55-22a81b07e5a7 service nova] Acquired lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:14:35 user nova-compute[74959]: DEBUG nova.network.neutron [req-7fc53415-0d96-4a22-9b3b-0d5ec0e8e3bb req-4f3d721c-b020-4ffe-8b55-22a81b07e5a7 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Refreshing network info cache for port c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'flavor' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-712924f7-1077-48b8-b02c-c4b5fc43f407 req-4623f7ca-2e45-45b5-a789-9678d4f6527b service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updated VIF entry in instance network info cache for port bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-712924f7-1077-48b8-b02c-c4b5fc43f407 req-4623f7ca-2e45-45b5-a789-9678d4f6527b service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-712924f7-1077-48b8-b02c-c4b5fc43f407 req-4623f7ca-2e45-45b5-a789-9678d4f6527b service nova] Releasing lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:36 user nova-compute[74959]: INFO nova.compute.manager [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Attaching volume d9b38ce6-a03f-4522-9536-54cf8742e26c to /dev/vdb
Nov 28 23:14:36 user nova-compute[74959]: DEBUG os_brick.utils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a143a5f8-2612-48de-bcec-52aa8eedebd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea025f-15c8-4b80-b447-52dc965794a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c220ad-3e6d-4d7e-bf63-b3bbcf31f011]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ccea8-c24e-4b25-b68a-c6c9eb77a070]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-7fc53415-0d96-4a22-9b3b-0d5ec0e8e3bb req-4f3d721c-b020-4ffe-8b55-22a81b07e5a7 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updated VIF entry in instance network info cache for port c897ce7f-6b41-4c61-9e90-56577c38cac7. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-7fc53415-0d96-4a22-9b3b-0d5ec0e8e3bb req-4f3d721c-b020-4ffe-8b55-22a81b07e5a7 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating instance_info_cache with network_info: [{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:14:36 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0627d975-bcc2-45d3-9212-ea85282aa7db]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG os_brick.utils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating existing volume attachment record: 4f250381-7a9f-4de0-ba39-f9d26c18dbfe {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7fc53415-0d96-4a22-9b3b-0d5ec0e8e3bb req-4f3d721c-b020-4ffe-8b55-22a81b07e5a7 service nova] Releasing lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-375d15b4-5875-4ed9-bcca-d36c2ae79b7c req-407050a0-c791-41e2-afc4-ff10ac87945c service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-375d15b4-5875-4ed9-bcca-d36c2ae79b7c req-407050a0-c791-41e2-afc4-ff10ac87945c service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-375d15b4-5875-4ed9-bcca-d36c2ae79b7c req-407050a0-c791-41e2-afc4-ff10ac87945c service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-375d15b4-5875-4ed9-bcca-d36c2ae79b7c req-407050a0-c791-41e2-afc4-ff10ac87945c service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-375d15b4-5875-4ed9-bcca-d36c2ae79b7c req-407050a0-c791-41e2-afc4-ff10ac87945c service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:37 user nova-compute[74959]: WARNING nova.compute.manager [req-375d15b4-5875-4ed9-bcca-d36c2ae79b7c req-407050a0-c791-41e2-afc4-ff10ac87945c service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-58120a77-6266-4c68-a883-d2ac70c45332 req-f6f05908-f8dd-47b6-a15c-6e400e9e3546 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-changed-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-58120a77-6266-4c68-a883-d2ac70c45332 req-f6f05908-f8dd-47b6-a15c-6e400e9e3546 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Refreshing instance network info cache due to event network-changed-c897ce7f-6b41-4c61-9e90-56577c38cac7. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:14:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-58120a77-6266-4c68-a883-d2ac70c45332 req-f6f05908-f8dd-47b6-a15c-6e400e9e3546 service nova] Acquiring lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:14:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-58120a77-6266-4c68-a883-d2ac70c45332 req-f6f05908-f8dd-47b6-a15c-6e400e9e3546 service nova] Acquired lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:14:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-58120a77-6266-4c68-a883-d2ac70c45332 req-f6f05908-f8dd-47b6-a15c-6e400e9e3546 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Refreshing network info cache for port c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:14:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-58120a77-6266-4c68-a883-d2ac70c45332 req-f6f05908-f8dd-47b6-a15c-6e400e9e3546 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updated VIF entry in instance network info cache for port c897ce7f-6b41-4c61-9e90-56577c38cac7. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:14:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-58120a77-6266-4c68-a883-d2ac70c45332 req-f6f05908-f8dd-47b6-a15c-6e400e9e3546 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating instance_info_cache with network_info: [{"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:14:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-58120a77-6266-4c68-a883-d2ac70c45332 req-f6f05908-f8dd-47b6-a15c-6e400e9e3546 service nova] Releasing lock "refresh_cache-63d3691b-4d3d-44ca-ab1a-d778d1ac7304" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-3832a37c-949f-47c5-ad07-899c04ab6aa4 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:39 user nova-compute[74959]: WARNING nova.compute.manager [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:14:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:39 user nova-compute[74959]: WARNING nova.compute.manager [req-e712b622-0b45-4778-b9a4-70f60ceea813 req-90141071-dd41-4b3d-adfc-77542a3f4027 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:14:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:41 user nova-compute[74959]: INFO nova.compute.manager [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Terminating instance
Nov 28 23:14:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-2f026df2-b7a4-4d8e-834a-0681e6c57bd4 req-04ca1718-7b64-4fcf-b30e-051272bda63f service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-unplugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2f026df2-b7a4-4d8e-834a-0681e6c57bd4 req-04ca1718-7b64-4fcf-b30e-051272bda63f service nova] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2f026df2-b7a4-4d8e-834a-0681e6c57bd4 req-04ca1718-7b64-4fcf-b30e-051272bda63f service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2f026df2-b7a4-4d8e-834a-0681e6c57bd4 req-04ca1718-7b64-4fcf-b30e-051272bda63f service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-2f026df2-b7a4-4d8e-834a-0681e6c57bd4 req-04ca1718-7b64-4fcf-b30e-051272bda63f service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] No waiting events found dispatching network-vif-unplugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-2f026df2-b7a4-4d8e-834a-0681e6c57bd4 req-04ca1718-7b64-4fcf-b30e-051272bda63f service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-unplugged-465c6e1b-9eb2-470e-8647-8b43d80e945a for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:14:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Instance destroyed successfully.
Nov 28 23:14:42 user nova-compute[74959]: DEBUG nova.objects.instance [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'resources' on Instance uuid d4c21a2d-bc24-4c8d-9703-7aa61f62713e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412234085',display_name='tempest-TestMinimumBasicScenario-server-1412234085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412234085',id=29,image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBau4EJ6PoO60hxDpjDXtquKde7d8Fp4tkYkc6XbpCFwbVop8/hgrcVzm9kBtN1WxHcF6o3d4i5XIQU2FPN6DN/V00LAqAHBgfvo/Kr7i4ZQV5XV/dtZ0mZIaxiaE0AknA==',key_name='tempest-TestMinimumBasicScenario-2066449073',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-c4w6rkrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d64a9a23-1ca3-4eba-8b25-b69652cc9814',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:12:02Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=d4c21a2d-bc24-4c8d-9703-7aa61f62713e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "address": "fa:16:3e:20:45:49", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465c6e1b-9e", "ovs_interfaceid": "465c6e1b-9eb2-470e-8647-8b43d80e945a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG os_vif [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap465c6e1b-9e, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4d9bf61-fc77-48c2-bec0-9b3ec01ed3c0) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:14:42 user nova-compute[74959]: INFO os_vif [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:45:49,bridge_name='br-int',has_traffic_filtering=True,id=465c6e1b-9eb2-470e-8647-8b43d80e945a,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465c6e1b-9e')
Nov 28 23:14:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Deleting instance files /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e_del
Nov 28 23:14:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Deletion of /opt/stack/data/nova/instances/d4c21a2d-bc24-4c8d-9703-7aa61f62713e_del complete
Nov 28 23:14:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: e245a015-fc98-4557-8168-5089c3746e79] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:14:42 user nova-compute[74959]: INFO nova.compute.manager [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 28 23:14:42 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:14:42 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating instance_info_cache with network_info: [{"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-e245a015-fc98-4557-8168-5089c3746e79" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:14:43 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Took 0.51 seconds to deallocate network for instance.
Nov 28 23:14:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-f932e78b-0eb4-405a-8361-a561f1e3d0ab req-030726e2-d3c3-436a-8b1f-ea8c2d2de80a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-deleted-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:43 user nova-compute[74959]: INFO nova.compute.manager [req-f932e78b-0eb4-405a-8361-a561f1e3d0ab req-030726e2-d3c3-436a-8b1f-ea8c2d2de80a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Neutron deleted interface 465c6e1b-9eb2-470e-8647-8b43d80e945a; detaching it from the instance and deleting it from the info cache
Nov 28 23:14:43 user nova-compute[74959]: DEBUG nova.network.neutron [req-f932e78b-0eb4-405a-8361-a561f1e3d0ab req-030726e2-d3c3-436a-8b1f-ea8c2d2de80a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-f932e78b-0eb4-405a-8361-a561f1e3d0ab req-030726e2-d3c3-436a-8b1f-ea8c2d2de80a service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Detach interface failed, port_id=465c6e1b-9eb2-470e-8647-8b43d80e945a, reason: Instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:14:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:43 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Deleted allocations for instance d4c21a2d-bc24-4c8d-9703-7aa61f62713e
Nov 28 23:14:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0ac16637-c37f-4c8f-9b46-ee6e6cc62907 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.326s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-c53003e0-0237-4e72-980b-71cf7ec6f3f2 req-a8128ce9-27f0-4cde-b921-6a62ce4ab220 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c53003e0-0237-4e72-980b-71cf7ec6f3f2 req-a8128ce9-27f0-4cde-b921-6a62ce4ab220 service nova] Acquiring lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c53003e0-0237-4e72-980b-71cf7ec6f3f2 req-a8128ce9-27f0-4cde-b921-6a62ce4ab220 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c53003e0-0237-4e72-980b-71cf7ec6f3f2 req-a8128ce9-27f0-4cde-b921-6a62ce4ab220 service nova] Lock "d4c21a2d-bc24-4c8d-9703-7aa61f62713e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-c53003e0-0237-4e72-980b-71cf7ec6f3f2 req-a8128ce9-27f0-4cde-b921-6a62ce4ab220 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] No waiting events found dispatching network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:44 user nova-compute[74959]: WARNING nova.compute.manager [req-c53003e0-0237-4e72-980b-71cf7ec6f3f2 req-a8128ce9-27f0-4cde-b921-6a62ce4ab220 service nova] [instance: d4c21a2d-bc24-4c8d-9703-7aa61f62713e] Received unexpected event network-vif-plugged-465c6e1b-9eb2-470e-8647-8b43d80e945a for instance with vm_state deleted and task_state None.
Nov 28 23:14:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:48 user nova-compute[74959]: INFO nova.compute.manager [None req-cdbefddd-90f4-4422-b980-2bdf282f9678 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Unrescuing
Nov 28 23:14:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cdbefddd-90f4-4422-b980-2bdf282f9678 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:14:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cdbefddd-90f4-4422-b980-2bdf282f9678 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquired lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:14:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cdbefddd-90f4-4422-b980-2bdf282f9678 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:14:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cdbefddd-90f4-4422-b980-2bdf282f9678 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Updating instance_info_cache with network_info: [{"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:14:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cdbefddd-90f4-4422-b980-2bdf282f9678 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Releasing lock "refresh_cache-16ec5cae-3d8c-427b-a117-e0b8be34be5f" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:14:48 user nova-compute[74959]: DEBUG nova.objects.instance [None req-cdbefddd-90f4-4422-b980-2bdf282f9678 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'flavor' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-4828d003-8501-4aa3-adc7-97a47a54031e req-1d471ab6-efe0-4c01-91fb-8e6cb0018d74 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4828d003-8501-4aa3-adc7-97a47a54031e req-1d471ab6-efe0-4c01-91fb-8e6cb0018d74 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4828d003-8501-4aa3-adc7-97a47a54031e req-1d471ab6-efe0-4c01-91fb-8e6cb0018d74 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4828d003-8501-4aa3-adc7-97a47a54031e req-1d471ab6-efe0-4c01-91fb-8e6cb0018d74 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-4828d003-8501-4aa3-adc7-97a47a54031e req-1d471ab6-efe0-4c01-91fb-8e6cb0018d74 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:49 user nova-compute[74959]: WARNING nova.compute.manager [req-4828d003-8501-4aa3-adc7-97a47a54031e req-1d471ab6-efe0-4c01-91fb-8e6cb0018d74 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:14:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:14:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:49 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance destroyed successfully.
Nov 28 23:14:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-e8092994-0b87-45fe-8f60-cdcdbcb8b13f req-facfeed9-01f4-4a84-98ca-93e957a774be service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e8092994-0b87-45fe-8f60-cdcdbcb8b13f req-facfeed9-01f4-4a84-98ca-93e957a774be service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e8092994-0b87-45fe-8f60-cdcdbcb8b13f req-facfeed9-01f4-4a84-98ca-93e957a774be service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e8092994-0b87-45fe-8f60-cdcdbcb8b13f req-facfeed9-01f4-4a84-98ca-93e957a774be service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-e8092994-0b87-45fe-8f60-cdcdbcb8b13f req-facfeed9-01f4-4a84-98ca-93e957a774be service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:51 user nova-compute[74959]: WARNING nova.compute.manager [req-e8092994-0b87-45fe-8f60-cdcdbcb8b13f req-facfeed9-01f4-4a84-98ca-93e957a774be service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:14:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:53 user nova-compute[74959]: WARNING nova.compute.manager [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:14:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:14:53 user nova-compute[74959]: WARNING nova.compute.manager [req-0e0f0754-0779-4629-b100-f5ad1530775b req-96fdbc27-ce8c-49d3-b5bb-e9eb35fab531 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:14:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cdbefddd-90f4-4422-b980-2bdf282f9678 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.640s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzkcxSwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:14:57 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:14:57 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:14:57 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:14:57 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:14:57 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7615MB free_disk=24.776500701904297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d00228a-a1e0-4630-baaa-fe7a98a2ad7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:14:57 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c047db24-9d05-45c5-858b-6b3098193bc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c] added
Nov 28 23:14:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b35be1-3153-455b-82f2-e56e2391bad9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[db934c92-1a2b-4ca4-b078-966ae11b0ba6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vzkcxSwX {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vzkcxSwX" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dd8260-328b-412e-bffd-dfd66ab6a49c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vzkcxSwX'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd78dd-9a3c-446e-8781-85399e32c9c1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[06122e30-97ab-4107-b847-46d5ca0a5a6d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[08db619b-bcf7-4f4b-a99a-897f55e89afa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c, portal: 172.16.0.220,3260]
Nov 28 23:14:57 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c, portal: 172.16.0.220,3260] successful.
Nov 28 23:14:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2427db-a300-4876-97f0-b4c01debf2f9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 16ec5cae-3d8c-427b-a117-e0b8be34be5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 97925529-42d3-45de-af1b-be5df85c70e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 4645bea5-5301-4394-9ad8-0bc352a99dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance a73da531-b1b4-4655-9511-ca0c1958acd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c510787-2a12-4e1f-9b17-c6e520128ca6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:14:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:14:57 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:14:57 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dbf122-38ce-4ec7-8c50-40a16e10ccfd]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzkcxSwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:14:57 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:14:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:14:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.875s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:14:58 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26261623864383663', 'path': '/dev/sde'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:14:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261623864383663', 'path': '/dev/sde'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:14:58 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'flavor' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:14:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:14:58 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:14:58 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:14:58 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:14:58 user nova-compute[74959]:   <serial>d9b38ce6-a03f-4522-9536-54cf8742e26c</serial>
Nov 28 23:14:58 user nova-compute[74959]: </disk>
Nov 28 23:14:58 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No VIF found with MAC fa:16:3e:e7:e9:4f, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e4c479bd-91ca-4956-ae0a-0a564f674ebd tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.823s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:14:59 user nova-compute[74959]: INFO nova.compute.manager [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Rescuing
Nov 28 23:14:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquired lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:14:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Releasing lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-d8b97240-4a6a-4906-b1d3-6c2f623186b4 req-8c65ee8d-4999-42ce-9326-84093781be70 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8b97240-4a6a-4906-b1d3-6c2f623186b4 req-8c65ee8d-4999-42ce-9326-84093781be70 service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8b97240-4a6a-4906-b1d3-6c2f623186b4 req-8c65ee8d-4999-42ce-9326-84093781be70 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8b97240-4a6a-4906-b1d3-6c2f623186b4 req-8c65ee8d-4999-42ce-9326-84093781be70 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-d8b97240-4a6a-4906-b1d3-6c2f623186b4 req-8c65ee8d-4999-42ce-9326-84093781be70 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:00 user nova-compute[74959]: WARNING nova.compute.manager [req-d8b97240-4a6a-4906-b1d3-6c2f623186b4 req-8c65ee8d-4999-42ce-9326-84093781be70 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state active and task_state rescuing.
Nov 28 23:15:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance destroyed successfully.
Nov 28 23:15:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Attempting rescue
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74959) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance directory exists: not creating {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 23:15:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Creating image(s)
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.rescue {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.rescue" returned: 0 in 0.051s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'migration_context' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.base [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<4645bea5-5301-4394-9ad8-0bc352a99dda> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Start _get_guest_xml network_info=[{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:e7:e9:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'resources' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.base [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<4645bea5-5301-4394-9ad8-0bc352a99dda> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'numa_topology' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.base [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<4645bea5-5301-4394-9ad8-0bc352a99dda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:15:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:15:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.base [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<4645bea5-5301-4394-9ad8-0bc352a99dda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1569794857',display_name='tempest-ServerRescueNegativeTestJSON-server-1569794857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1569794857',id=33,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVysS3wm5gNN0sa78SgQSsn8xRGlM6MBHgrhRblr4un5CiVi8uL0dJtSlnH30HwHIymOKFVZsbT5qxsOmGiH4UEop/VlBkYS3j1EyzNlJ0IoLKCaCARh1LupX6FPx3Ang==',key_name='tempest-keypair-30517445',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-r9arql55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=4645bea5-5301-4394-9ad8-0bc352a99dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:e7:e9:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "vif_mac": "fa:16:3e:e7:e9:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:4f,bridge_name='br-int',has_traffic_filtering=True,id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf941ff4-5a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'pci_devices' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.objects.base [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Object Instance<4645bea5-5301-4394-9ad8-0bc352a99dda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:15:01 user nova-compute[74959]:   <uuid>4645bea5-5301-4394-9ad8-0bc352a99dda</uuid>
Nov 28 23:15:01 user nova-compute[74959]:   <name>instance-00000021</name>
Nov 28 23:15:01 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:15:01 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:15:01 user nova-compute[74959]:   <metadata>
Nov 28 23:15:01 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:15:01 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:15:01 user nova-compute[74959]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1569794857</nova:name>
Nov 28 23:15:01 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:15:01</nova:creationTime>
Nov 28 23:15:01 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:15:01 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:15:01 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:15:01 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:15:01 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:15:01 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:15:01 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:15:01 user nova-compute[74959]:       <nova:owner>
Nov 28 23:15:01 user nova-compute[74959]:         <nova:user uuid="a59fecc5b484491ca4f6b326d8bfcb67">tempest-ServerRescueNegativeTestJSON-1452838145-project-member</nova:user>
Nov 28 23:15:01 user nova-compute[74959]:         <nova:project uuid="d69f1c42c1314a41ac6a4ae41fb64c7c">tempest-ServerRescueNegativeTestJSON-1452838145</nova:project>
Nov 28 23:15:01 user nova-compute[74959]:       </nova:owner>
Nov 28 23:15:01 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:15:01 user nova-compute[74959]:       <nova:ports>
Nov 28 23:15:01 user nova-compute[74959]:         <nova:port uuid="bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd">
Nov 28 23:15:01 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 23:15:01 user nova-compute[74959]:         </nova:port>
Nov 28 23:15:01 user nova-compute[74959]:       </nova:ports>
Nov 28 23:15:01 user nova-compute[74959]:     </nova:instance>
Nov 28 23:15:01 user nova-compute[74959]:   </metadata>
Nov 28 23:15:01 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:15:01 user nova-compute[74959]:     <system>
Nov 28 23:15:01 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:15:01 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:15:01 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:15:01 user nova-compute[74959]:       <entry name="serial">4645bea5-5301-4394-9ad8-0bc352a99dda</entry>
Nov 28 23:15:01 user nova-compute[74959]:       <entry name="uuid">4645bea5-5301-4394-9ad8-0bc352a99dda</entry>
Nov 28 23:15:01 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:15:01 user nova-compute[74959]:     </system>
Nov 28 23:15:01 user nova-compute[74959]:   </sysinfo>
Nov 28 23:15:01 user nova-compute[74959]:   <os>
Nov 28 23:15:01 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:15:01 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:15:01 user nova-compute[74959]:   </os>
Nov 28 23:15:01 user nova-compute[74959]:   <features>
Nov 28 23:15:01 user nova-compute[74959]:     <acpi/>
Nov 28 23:15:01 user nova-compute[74959]:     <apic/>
Nov 28 23:15:01 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:15:01 user nova-compute[74959]:   </features>
Nov 28 23:15:01 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:15:01 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:15:01 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:15:01 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:15:01 user nova-compute[74959]:   </clock>
Nov 28 23:15:01 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:15:01 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:15:01 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:15:01 user nova-compute[74959]:   </cpu>
Nov 28 23:15:01 user nova-compute[74959]:   <devices>
Nov 28 23:15:01 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:15:01 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:15:01 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.rescue"/>
Nov 28 23:15:01 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:15:01 user nova-compute[74959]:     </disk>
Nov 28 23:15:01 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:15:01 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:15:01 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk"/>
Nov 28 23:15:01 user nova-compute[74959]:       <target dev="vdb" bus="virtio"/>
Nov 28 23:15:01 user nova-compute[74959]:     </disk>
Nov 28 23:15:01 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:15:01 user nova-compute[74959]:       <mac address="fa:16:3e:e7:e9:4f"/>
Nov 28 23:15:01 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:15:01 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:15:01 user nova-compute[74959]:       <target dev="tapbf941ff4-5a"/>
Nov 28 23:15:01 user nova-compute[74959]:     </interface>
Nov 28 23:15:01 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:15:01 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/console.log" append="off"/>
Nov 28 23:15:01 user nova-compute[74959]:     </serial>
Nov 28 23:15:01 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:15:01 user nova-compute[74959]:     <video>
Nov 28 23:15:01 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:15:01 user nova-compute[74959]:     </video>
Nov 28 23:15:01 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:15:01 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:15:01 user nova-compute[74959]:     </rng>
Nov 28 23:15:01 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:15:01 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:15:01 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:15:01 user nova-compute[74959]:     </memballoon>
Nov 28 23:15:01 user nova-compute[74959]:   </devices>
Nov 28 23:15:01 user nova-compute[74959]: </domain>
Nov 28 23:15:01 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:15:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance destroyed successfully.
Nov 28 23:15:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:15:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] No VIF found with MAC fa:16:3e:e7:e9:4f, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:15:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-5d6883af-99eb-4441-8159-c70fde64c4f0 req-11996221-0db1-4f32-850b-c221af6c8c67 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5d6883af-99eb-4441-8159-c70fde64c4f0 req-11996221-0db1-4f32-850b-c221af6c8c67 service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5d6883af-99eb-4441-8159-c70fde64c4f0 req-11996221-0db1-4f32-850b-c221af6c8c67 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5d6883af-99eb-4441-8159-c70fde64c4f0 req-11996221-0db1-4f32-850b-c221af6c8c67 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-5d6883af-99eb-4441-8159-c70fde64c4f0 req-11996221-0db1-4f32-850b-c221af6c8c67 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:02 user nova-compute[74959]: WARNING nova.compute.manager [req-5d6883af-99eb-4441-8159-c70fde64c4f0 req-11996221-0db1-4f32-850b-c221af6c8c67 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state active and task_state rescuing.
Nov 28 23:15:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:04 user nova-compute[74959]: WARNING nova.compute.manager [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state active and task_state rescuing.
Nov 28 23:15:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:04 user nova-compute[74959]: DEBUG nova.compute.manager [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:04 user nova-compute[74959]: WARNING nova.compute.manager [req-39824f2b-d8b6-461d-8e37-611d727d0061 req-d21e96a3-fd98-4480-8847-925c00663c4f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state active and task_state rescuing.
Nov 28 23:15:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e8d98809-22f7-4372-9b2e-b17d5f74106a tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:15:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:07 user nova-compute[74959]: INFO nova.compute.manager [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Detaching volume d29e40db-089e-49f8-86fa-9c86490d7ee5
Nov 28 23:15:08 user nova-compute[74959]: INFO nova.virt.block_device [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Attempting to driver detach volume d29e40db-089e-49f8-86fa-9c86490d7ee5 from mountpoint /dev/vdb
Nov 28 23:15:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Attempting to detach device vdb from instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:15:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:15:08 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:15:08 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:15:08 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:15:08 user nova-compute[74959]:   <serial>d29e40db-089e-49f8-86fa-9c86490d7ee5</serial>
Nov 28 23:15:08 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:15:08 user nova-compute[74959]: </disk>
Nov 28 23:15:08 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:15:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Successfully detached device vdb from instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 from the persistent domain config.
Nov 28 23:15:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:15:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:15:08 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:15:08 user nova-compute[74959]:   <source dev="/dev/sdg"/>
Nov 28 23:15:08 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:15:08 user nova-compute[74959]:   <serial>d29e40db-089e-49f8-86fa-9c86490d7ee5</serial>
Nov 28 23:15:08 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:15:08 user nova-compute[74959]: </disk>
Nov 28 23:15:08 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:15:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "a73da531-b1b4-4655-9511-ca0c1958acd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:09 user nova-compute[74959]: INFO nova.compute.manager [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Terminating instance
Nov 28 23:15:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-6f3cdb88-07d3-40f7-91fc-e53bb4a0428a req-9adf6887-542d-44a9-bff9-346556276bb8 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received event network-vif-unplugged-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6f3cdb88-07d3-40f7-91fc-e53bb4a0428a req-9adf6887-542d-44a9-bff9-346556276bb8 service nova] Acquiring lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6f3cdb88-07d3-40f7-91fc-e53bb4a0428a req-9adf6887-542d-44a9-bff9-346556276bb8 service nova] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6f3cdb88-07d3-40f7-91fc-e53bb4a0428a req-9adf6887-542d-44a9-bff9-346556276bb8 service nova] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-6f3cdb88-07d3-40f7-91fc-e53bb4a0428a req-9adf6887-542d-44a9-bff9-346556276bb8 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] No waiting events found dispatching network-vif-unplugged-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-6f3cdb88-07d3-40f7-91fc-e53bb4a0428a req-9adf6887-542d-44a9-bff9-346556276bb8 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received event network-vif-unplugged-b1350eea-df12-413f-91d2-051310d9b313 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:15:09 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Instance destroyed successfully.
Nov 28 23:15:09 user nova-compute[74959]: DEBUG nova.objects.instance [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lazy-loading 'resources' on Instance uuid a73da531-b1b4-4655-9511-ca0c1958acd9 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-752507818',display_name='tempest-VolumesActionsTest-instance-752507818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-752507818',id=34,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e30e0f48d51e48df8a0061cb76139617',ramdisk_id='',reservation_id='r-8d0lhh0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1720378458',owner_user_name='tempest-VolumesActionsTest-1720378458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:13:17Z,user_data=None,user_id='ba7d09ce239f44509d5c41a81fb422e0',uuid=a73da531-b1b4-4655-9511-ca0c1958acd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Converting VIF {"id": "b1350eea-df12-413f-91d2-051310d9b313", "address": "fa:16:3e:65:a8:aa", "network": {"id": "a9ea48c4-5317-441b-a6c3-e5cd1733fe5b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2017395053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30e0f48d51e48df8a0061cb76139617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1350eea-df", "ovs_interfaceid": "b1350eea-df12-413f-91d2-051310d9b313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b1350eea-df12-413f-91d2-051310d9b313,network=Network(a9ea48c4-5317-441b-a6c3-e5cd1733fe5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1350eea-df') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG os_vif [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b1350eea-df12-413f-91d2-051310d9b313,network=Network(a9ea48c4-5317-441b-a6c3-e5cd1733fe5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1350eea-df') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1350eea-df, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aee31523-b262-4b29-9653-d6568bcbb354) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:10 user nova-compute[74959]: INFO os_vif [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b1350eea-df12-413f-91d2-051310d9b313,network=Network(a9ea48c4-5317-441b-a6c3-e5cd1733fe5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1350eea-df')
Nov 28 23:15:10 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Deleting instance files /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9_del
Nov 28 23:15:10 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Deletion of /opt/stack/data/nova/instances/a73da531-b1b4-4655-9511-ca0c1958acd9_del complete
Nov 28 23:15:10 user nova-compute[74959]: INFO nova.compute.manager [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 28 23:15:10 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:15:10 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-da4aa453-8236-4ef6-8a7d-4b27a931d43f req-a2a53e0d-a398-49cf-a093-f8e99684dd9c service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received event network-vif-deleted-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:11 user nova-compute[74959]: INFO nova.compute.manager [req-da4aa453-8236-4ef6-8a7d-4b27a931d43f req-a2a53e0d-a398-49cf-a093-f8e99684dd9c service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Neutron deleted interface b1350eea-df12-413f-91d2-051310d9b313; detaching it from the instance and deleting it from the info cache
Nov 28 23:15:11 user nova-compute[74959]: DEBUG nova.network.neutron [req-da4aa453-8236-4ef6-8a7d-4b27a931d43f req-a2a53e0d-a398-49cf-a093-f8e99684dd9c service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-da4aa453-8236-4ef6-8a7d-4b27a931d43f req-a2a53e0d-a398-49cf-a093-f8e99684dd9c service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Detach interface failed, port_id=b1350eea-df12-413f-91d2-051310d9b313, reason: Instance a73da531-b1b4-4655-9511-ca0c1958acd9 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:15:11 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Took 1.16 seconds to deallocate network for instance.
Nov 28 23:15:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-3dedde42-4ed8-44b9-bab0-51d081ee3caf req-8381e50d-433f-4d01-be0c-7e37b4f08740 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received event network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3dedde42-4ed8-44b9-bab0-51d081ee3caf req-8381e50d-433f-4d01-be0c-7e37b4f08740 service nova] Acquiring lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3dedde42-4ed8-44b9-bab0-51d081ee3caf req-8381e50d-433f-4d01-be0c-7e37b4f08740 service nova] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3dedde42-4ed8-44b9-bab0-51d081ee3caf req-8381e50d-433f-4d01-be0c-7e37b4f08740 service nova] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-3dedde42-4ed8-44b9-bab0-51d081ee3caf req-8381e50d-433f-4d01-be0c-7e37b4f08740 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] No waiting events found dispatching network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:11 user nova-compute[74959]: WARNING nova.compute.manager [req-3dedde42-4ed8-44b9-bab0-51d081ee3caf req-8381e50d-433f-4d01-be0c-7e37b4f08740 service nova] [instance: a73da531-b1b4-4655-9511-ca0c1958acd9] Received unexpected event network-vif-plugged-b1350eea-df12-413f-91d2-051310d9b313 for instance with vm_state deleted and task_state None.
Nov 28 23:15:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:11 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Deleted allocations for instance a73da531-b1b4-4655-9511-ca0c1958acd9
Nov 28 23:15:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9cc46f42-8ae7-44a9-8fe4-8ff996e462e3 tempest-VolumesActionsTest-1720378458 tempest-VolumesActionsTest-1720378458-project-member] Lock "a73da531-b1b4-4655-9511-ca0c1958acd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.657s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:15:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:15:22 user nova-compute[74959]: INFO nova.compute.claims [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Claim successful on node user
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.network.neutron [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:15:23 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.policy [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18a99b86ac9844fd8ad2329e41d22c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e44315cc7e42f3ac72740bfba170e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:15:23 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Creating image(s)
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "/opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "/opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "/opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.228s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:23 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.network.neutron [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Successfully created port: 27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk 1073741824" returned: 0 in 0.060s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Cannot resize image /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Ensure instance console log exists: /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.network.neutron [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Successfully updated port: 27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquired lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.network.neutron [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-631f724d-e239-4a9b-a2b5-404d59fc3406 req-956e61f3-63d9-440d-ac31-2fcbd30d7bed service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received event network-changed-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-631f724d-e239-4a9b-a2b5-404d59fc3406 req-956e61f3-63d9-440d-ac31-2fcbd30d7bed service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Refreshing instance network info cache due to event network-changed-27594395-9f1d-495d-b4d9-744a7ab8f4e2. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-631f724d-e239-4a9b-a2b5-404d59fc3406 req-956e61f3-63d9-440d-ac31-2fcbd30d7bed service nova] Acquiring lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:15:24 user nova-compute[74959]: DEBUG nova.network.neutron [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.network.neutron [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Updating instance_info_cache with network_info: [{"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Releasing lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Instance network_info: |[{"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-631f724d-e239-4a9b-a2b5-404d59fc3406 req-956e61f3-63d9-440d-ac31-2fcbd30d7bed service nova] Acquired lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.network.neutron [req-631f724d-e239-4a9b-a2b5-404d59fc3406 req-956e61f3-63d9-440d-ac31-2fcbd30d7bed service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Refreshing network info cache for port 27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Start _get_guest_xml network_info=[{"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:15:25 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:15:25 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2041217511',display_name='tempest-VolumesSnapshotTestJSON-instance-2041217511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2041217511',id=35,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwNzBxAxqAznRZykuH0FZzgT7h/zOnBRQiSXpenyKQWQWMk9Vrub4UWZ0zIaQscvgrk4YftRNoW6xEIj9MU85kTG3G/9L7M1gxdPq/ILT8b2Me7jnp4tgOXIz0PP5cq+Q==',key_name='tempest-keypair-383029919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4e44315cc7e42f3ac72740bfba170e4',ramdisk_id='',reservation_id='r-mosc75d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1119708422',owner_user_name='tempest-VolumesSnapshotTestJSON-1119708422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18a99b86ac9844fd8ad2329e41d22c65',uuid=79fface9-6208-4ed9-82dc-800dc7f25364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converting VIF {"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:87:00,bridge_name='br-int',has_traffic_filtering=True,id=27594395-9f1d-495d-b4d9-744a7ab8f4e2,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27594395-9f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.objects.instance [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'pci_devices' on Instance uuid 79fface9-6208-4ed9-82dc-800dc7f25364 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:15:25 user nova-compute[74959]:   <uuid>79fface9-6208-4ed9-82dc-800dc7f25364</uuid>
Nov 28 23:15:25 user nova-compute[74959]:   <name>instance-00000023</name>
Nov 28 23:15:25 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:15:25 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:15:25 user nova-compute[74959]:   <metadata>
Nov 28 23:15:25 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:15:25 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:15:25 user nova-compute[74959]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2041217511</nova:name>
Nov 28 23:15:25 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:15:25</nova:creationTime>
Nov 28 23:15:25 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:15:25 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:15:25 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:15:25 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:15:25 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:15:25 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:15:25 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:15:25 user nova-compute[74959]:       <nova:owner>
Nov 28 23:15:25 user nova-compute[74959]:         <nova:user uuid="18a99b86ac9844fd8ad2329e41d22c65">tempest-VolumesSnapshotTestJSON-1119708422-project-member</nova:user>
Nov 28 23:15:25 user nova-compute[74959]:         <nova:project uuid="b4e44315cc7e42f3ac72740bfba170e4">tempest-VolumesSnapshotTestJSON-1119708422</nova:project>
Nov 28 23:15:25 user nova-compute[74959]:       </nova:owner>
Nov 28 23:15:25 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:15:25 user nova-compute[74959]:       <nova:ports>
Nov 28 23:15:25 user nova-compute[74959]:         <nova:port uuid="27594395-9f1d-495d-b4d9-744a7ab8f4e2">
Nov 28 23:15:25 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:15:25 user nova-compute[74959]:         </nova:port>
Nov 28 23:15:25 user nova-compute[74959]:       </nova:ports>
Nov 28 23:15:25 user nova-compute[74959]:     </nova:instance>
Nov 28 23:15:25 user nova-compute[74959]:   </metadata>
Nov 28 23:15:25 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:15:25 user nova-compute[74959]:     <system>
Nov 28 23:15:25 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:15:25 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:15:25 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:15:25 user nova-compute[74959]:       <entry name="serial">79fface9-6208-4ed9-82dc-800dc7f25364</entry>
Nov 28 23:15:25 user nova-compute[74959]:       <entry name="uuid">79fface9-6208-4ed9-82dc-800dc7f25364</entry>
Nov 28 23:15:25 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:15:25 user nova-compute[74959]:     </system>
Nov 28 23:15:25 user nova-compute[74959]:   </sysinfo>
Nov 28 23:15:25 user nova-compute[74959]:   <os>
Nov 28 23:15:25 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:15:25 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:15:25 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:15:25 user nova-compute[74959]:   </os>
Nov 28 23:15:25 user nova-compute[74959]:   <features>
Nov 28 23:15:25 user nova-compute[74959]:     <acpi/>
Nov 28 23:15:25 user nova-compute[74959]:     <apic/>
Nov 28 23:15:25 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:15:25 user nova-compute[74959]:   </features>
Nov 28 23:15:25 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:15:25 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:15:25 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:15:25 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:15:25 user nova-compute[74959]:   </clock>
Nov 28 23:15:25 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:15:25 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:15:25 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:15:25 user nova-compute[74959]:   </cpu>
Nov 28 23:15:25 user nova-compute[74959]:   <devices>
Nov 28 23:15:25 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:15:25 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:15:25 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk"/>
Nov 28 23:15:25 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:15:25 user nova-compute[74959]:     </disk>
Nov 28 23:15:25 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:15:25 user nova-compute[74959]:       <mac address="fa:16:3e:c7:87:00"/>
Nov 28 23:15:25 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:15:25 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:15:25 user nova-compute[74959]:       <target dev="tap27594395-9f"/>
Nov 28 23:15:25 user nova-compute[74959]:     </interface>
Nov 28 23:15:25 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:15:25 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/console.log" append="off"/>
Nov 28 23:15:25 user nova-compute[74959]:     </serial>
Nov 28 23:15:25 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:15:25 user nova-compute[74959]:     <video>
Nov 28 23:15:25 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:15:25 user nova-compute[74959]:     </video>
Nov 28 23:15:25 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:15:25 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:15:25 user nova-compute[74959]:     </rng>
Nov 28 23:15:25 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:15:25 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:15:25 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:15:25 user nova-compute[74959]:     </memballoon>
Nov 28 23:15:25 user nova-compute[74959]:   </devices>
Nov 28 23:15:25 user nova-compute[74959]: </domain>
Nov 28 23:15:25 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2041217511',display_name='tempest-VolumesSnapshotTestJSON-instance-2041217511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2041217511',id=35,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwNzBxAxqAznRZykuH0FZzgT7h/zOnBRQiSXpenyKQWQWMk9Vrub4UWZ0zIaQscvgrk4YftRNoW6xEIj9MU85kTG3G/9L7M1gxdPq/ILT8b2Me7jnp4tgOXIz0PP5cq+Q==',key_name='tempest-keypair-383029919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4e44315cc7e42f3ac72740bfba170e4',ramdisk_id='',reservation_id='r-mosc75d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1119708422',owner_user_name='tempest-VolumesSnapshotTestJSON-1119708422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18a99b86ac9844fd8ad2329e41d22c65',uuid=79fface9-6208-4ed9-82dc-800dc7f25364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converting VIF {"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:87:00,bridge_name='br-int',has_traffic_filtering=True,id=27594395-9f1d-495d-b4d9-744a7ab8f4e2,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27594395-9f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG os_vif [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:87:00,bridge_name='br-int',has_traffic_filtering=True,id=27594395-9f1d-495d-b4d9-744a7ab8f4e2,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27594395-9f') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17b1f5a5-5238-5d2c-beb4-c893a8f5a9b6', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27594395-9f, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27594395-9f, col_values=(('qos', UUID('de974d29-263a-45da-bbf6-aec4e15821bd')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27594395-9f, col_values=(('external_ids', {'iface-id': '27594395-9f1d-495d-b4d9-744a7ab8f4e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:87:00', 'vm-uuid': '79fface9-6208-4ed9-82dc-800dc7f25364'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:25 user nova-compute[74959]: INFO os_vif [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:87:00,bridge_name='br-int',has_traffic_filtering=True,id=27594395-9f1d-495d-b4d9-744a7ab8f4e2,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27594395-9f')
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No VIF found with MAC fa:16:3e:c7:87:00, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.network.neutron [req-631f724d-e239-4a9b-a2b5-404d59fc3406 req-956e61f3-63d9-440d-ac31-2fcbd30d7bed service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Updated VIF entry in instance network info cache for port 27594395-9f1d-495d-b4d9-744a7ab8f4e2. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG nova.network.neutron [req-631f724d-e239-4a9b-a2b5-404d59fc3406 req-956e61f3-63d9-440d-ac31-2fcbd30d7bed service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Updating instance_info_cache with network_info: [{"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:15:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-631f724d-e239-4a9b-a2b5-404d59fc3406 req-956e61f3-63d9-440d-ac31-2fcbd30d7bed service nova] Releasing lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:15:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-34fc6b52-3976-4f3d-a738-c8876be85143 req-2ca28376-8e1f-4d9d-8d84-aedf25030ca6 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received event network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-34fc6b52-3976-4f3d-a738-c8876be85143 req-2ca28376-8e1f-4d9d-8d84-aedf25030ca6 service nova] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-34fc6b52-3976-4f3d-a738-c8876be85143 req-2ca28376-8e1f-4d9d-8d84-aedf25030ca6 service nova] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-34fc6b52-3976-4f3d-a738-c8876be85143 req-2ca28376-8e1f-4d9d-8d84-aedf25030ca6 service nova] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-34fc6b52-3976-4f3d-a738-c8876be85143 req-2ca28376-8e1f-4d9d-8d84-aedf25030ca6 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] No waiting events found dispatching network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:27 user nova-compute[74959]: WARNING nova.compute.manager [req-34fc6b52-3976-4f3d-a738-c8876be85143 req-2ca28376-8e1f-4d9d-8d84-aedf25030ca6 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received unexpected event network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 for instance with vm_state building and task_state spawning.
Nov 28 23:15:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 is timed out.
Nov 28 23:15:28 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Successfully detached device vdb from instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 from the live domain config.
Nov 28 23:15:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HzmtcjnL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:15:28 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a57dc-b0a9-4ee6-a96d-7b7bec51a116]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:15:28 user nova-compute[74959]: No targets found.
Nov 28 23:15:28 user nova-compute[74959]: iSNS:
Nov 28 23:15:28 user nova-compute[74959]: No targets found.
Nov 28 23:15:28 user nova-compute[74959]: STATIC:
Nov 28 23:15:28 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28
Nov 28 23:15:28 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:15:28 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:15:28 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c
Nov 28 23:15:28 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:15:28 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:15:28 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:15:28 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:15:28 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:15:28 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:15:28 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:15:28 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:15:28 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5
Nov 28 23:15:28 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:15:28 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:15:28 user nova-compute[74959]: FIRMWARE:
Nov 28 23:15:28 user nova-compute[74959]: No targets found.
Nov 28 23:15:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:15:28 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:15:28 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcea277-c880-48eb-ab37-f5c1f2bd4a06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fef596-366c-454b-9fed-55cee09f9770]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:15:28 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:15:28 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:15:28 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:15:28 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:15:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:15:28 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:15:28 user nova-compute[74959]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 (non-flash)
Nov 28 23:15:28 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:15:28 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:15:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef49069e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5'): ({'sdg'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Removing single pathed devices sdg {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14d2575-0c5a-4357-86cf-430f499d7706]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ba6c97-7697-4eae-860d-47e0e4cb166a]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Flushing IO for device /dev/sdg {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[167c5962-5b33-44ba-8c7d-81e17c48a8b3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[be25d868-e37d-48a4-a374-aa25f348d55f]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] SCSI volumes sdg have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41488cd-2e7e-4f49-9e22-9d13033ab540]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7694bea6-1051-44d2-bd5f-a0046f8ffa01]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5, portal: 172.16.0.220,3260]
Nov 28 23:15:28 user nova-compute[74959]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5, portal: 172.16.0.220,3260] successful.
Nov 28 23:15:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:15:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d29e40db-089e-49f8-86fa-9c86490d7ee5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[797a49b2-6018-4328-bfe4-13f2fc41f994]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] <== disconnect_volume: return (343ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:15:29 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Instance spawned successfully.
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.compute.manager [req-b71d4562-2cbf-4f33-a5b3-5f50ecfa2c00 req-0fd9df40-f6ea-415e-b9f1-50eaee8f87d5 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received event network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b71d4562-2cbf-4f33-a5b3-5f50ecfa2c00 req-0fd9df40-f6ea-415e-b9f1-50eaee8f87d5 service nova] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b71d4562-2cbf-4f33-a5b3-5f50ecfa2c00 req-0fd9df40-f6ea-415e-b9f1-50eaee8f87d5 service nova] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b71d4562-2cbf-4f33-a5b3-5f50ecfa2c00 req-0fd9df40-f6ea-415e-b9f1-50eaee8f87d5 service nova] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.compute.manager [req-b71d4562-2cbf-4f33-a5b3-5f50ecfa2c00 req-0fd9df40-f6ea-415e-b9f1-50eaee8f87d5 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] No waiting events found dispatching network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:29 user nova-compute[74959]: WARNING nova.compute.manager [req-b71d4562-2cbf-4f33-a5b3-5f50ecfa2c00 req-0fd9df40-f6ea-415e-b9f1-50eaee8f87d5 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received unexpected event network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 for instance with vm_state building and task_state spawning.
Nov 28 23:15:29 user nova-compute[74959]: INFO nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:15:29 user nova-compute[74959]: INFO nova.compute.manager [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Took 6.34 seconds to build instance.
Nov 28 23:15:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-0007112b-498d-4884-8c9d-d9c6a5d05e3f tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.454s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG nova.objects.instance [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'flavor' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-350181df-e2f6-43f3-b9fd-f52ed4f3d9e8 tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.998s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:15:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:36 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:15:36 user nova-compute[74959]: INFO nova.compute.claims [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Claim successful on node user
Nov 28 23:15:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:15:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.policy [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3b7bfca433f4f1ab07b34aa3b5faa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94592793a8e4345b9357f03062cca9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:15:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Creating image(s)
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "/opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "/opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "/opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "9ec0ea7be0e4794c2a031fe103692894006c4ddc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "9ec0ea7be0e4794c2a031fe103692894006c4ddc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Successfully created port: a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc.part --force-share --output=json" returned: 0 in 0.226s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.virt.images [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] 5043ed02-2334-4e3d-88aa-8c981af72663 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:15:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc.part /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc.part /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc.converted" returned: 0 in 0.217s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "9ec0ea7be0e4794c2a031fe103692894006c4ddc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.139s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Successfully updated port: a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquired lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-afd20f35-28a6-4b65-b167-f769dab25c9e req-25cc85d9-d018-4aa6-aa7a-57937da16aac service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-afd20f35-28a6-4b65-b167-f769dab25c9e req-25cc85d9-d018-4aa6-aa7a-57937da16aac service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing instance network info cache due to event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-afd20f35-28a6-4b65-b167-f769dab25c9e req-25cc85d9-d018-4aa6-aa7a-57937da16aac service nova] Acquiring lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc --force-share --output=json" returned: 0 in 0.218s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "9ec0ea7be0e4794c2a031fe103692894006c4ddc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "9ec0ea7be0e4794c2a031fe103692894006c4ddc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc,backing_fmt=raw /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc,backing_fmt=raw /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk 1073741824" returned: 0 in 0.049s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "9ec0ea7be0e4794c2a031fe103692894006c4ddc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Cannot resize image /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Ensure instance console log exists: /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.network.neutron [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Releasing lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Instance network_info: |[{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-afd20f35-28a6-4b65-b167-f769dab25c9e req-25cc85d9-d018-4aa6-aa7a-57937da16aac service nova] Acquired lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-afd20f35-28a6-4b65-b167-f769dab25c9e req-25cc85d9-d018-4aa6-aa7a-57937da16aac service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Start _get_guest_xml network_info=[{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T23:15:33Z,direct_url=<?>,disk_format='qcow2',id=5043ed02-2334-4e3d-88aa-8c981af72663,min_disk=0,min_ram=0,name='tempest-scenario-img--961196316',owner='b94592793a8e4345b9357f03062cca9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T23:15:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': '5043ed02-2334-4e3d-88aa-8c981af72663'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:15:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:15:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T23:15:33Z,direct_url=<?>,disk_format='qcow2',id=5043ed02-2334-4e3d-88aa-8c981af72663,min_disk=0,min_ram=0,name='tempest-scenario-img--961196316',owner='b94592793a8e4345b9357f03062cca9a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T23:15:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1541535247',display_name='tempest-TestMinimumBasicScenario-server-1541535247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1541535247',id=36,image_ref='5043ed02-2334-4e3d-88aa-8c981af72663',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4CzHNiRuySWSAK+eIKs6fm1TVCxQ9WzZc5P+ymVAtljef1RJckew0PIYOFxhMU+2wPhZDs1v966+XQ4w3F6XirgpFdgkgH3+mThCFMFP6RgcC5bpOPww69rcm5YUrSAw==',key_name='tempest-TestMinimumBasicScenario-1531585152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-xo6rn83t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5043ed02-2334-4e3d-88aa-8c981af72663',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:15:37Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=2704bdaf-e70f-469e-9e88-b711b229dd6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f5:d8,bridge_name='br-int',has_traffic_filtering=True,id=a2a17a6c-2cde-4c06-bba8-23c3390260e3,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a17a6c-2c') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.objects.instance [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'pci_devices' on Instance uuid 2704bdaf-e70f-469e-9e88-b711b229dd6b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:15:39 user nova-compute[74959]:   <uuid>2704bdaf-e70f-469e-9e88-b711b229dd6b</uuid>
Nov 28 23:15:39 user nova-compute[74959]:   <name>instance-00000024</name>
Nov 28 23:15:39 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:15:39 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:15:39 user nova-compute[74959]:   <metadata>
Nov 28 23:15:39 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:15:39 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:15:39 user nova-compute[74959]:       <nova:name>tempest-TestMinimumBasicScenario-server-1541535247</nova:name>
Nov 28 23:15:39 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:15:39</nova:creationTime>
Nov 28 23:15:39 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:15:39 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:15:39 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:15:39 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:15:39 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:15:39 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:15:39 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:15:39 user nova-compute[74959]:       <nova:owner>
Nov 28 23:15:39 user nova-compute[74959]:         <nova:user uuid="d3b7bfca433f4f1ab07b34aa3b5faa42">tempest-TestMinimumBasicScenario-615443694-project-member</nova:user>
Nov 28 23:15:39 user nova-compute[74959]:         <nova:project uuid="b94592793a8e4345b9357f03062cca9a">tempest-TestMinimumBasicScenario-615443694</nova:project>
Nov 28 23:15:39 user nova-compute[74959]:       </nova:owner>
Nov 28 23:15:39 user nova-compute[74959]:       <nova:root type="image" uuid="5043ed02-2334-4e3d-88aa-8c981af72663"/>
Nov 28 23:15:39 user nova-compute[74959]:       <nova:ports>
Nov 28 23:15:39 user nova-compute[74959]:         <nova:port uuid="a2a17a6c-2cde-4c06-bba8-23c3390260e3">
Nov 28 23:15:39 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:15:39 user nova-compute[74959]:         </nova:port>
Nov 28 23:15:39 user nova-compute[74959]:       </nova:ports>
Nov 28 23:15:39 user nova-compute[74959]:     </nova:instance>
Nov 28 23:15:39 user nova-compute[74959]:   </metadata>
Nov 28 23:15:39 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:15:39 user nova-compute[74959]:     <system>
Nov 28 23:15:39 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:15:39 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:15:39 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:15:39 user nova-compute[74959]:       <entry name="serial">2704bdaf-e70f-469e-9e88-b711b229dd6b</entry>
Nov 28 23:15:39 user nova-compute[74959]:       <entry name="uuid">2704bdaf-e70f-469e-9e88-b711b229dd6b</entry>
Nov 28 23:15:39 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:15:39 user nova-compute[74959]:     </system>
Nov 28 23:15:39 user nova-compute[74959]:   </sysinfo>
Nov 28 23:15:39 user nova-compute[74959]:   <os>
Nov 28 23:15:39 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:15:39 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:15:39 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:15:39 user nova-compute[74959]:   </os>
Nov 28 23:15:39 user nova-compute[74959]:   <features>
Nov 28 23:15:39 user nova-compute[74959]:     <acpi/>
Nov 28 23:15:39 user nova-compute[74959]:     <apic/>
Nov 28 23:15:39 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:15:39 user nova-compute[74959]:   </features>
Nov 28 23:15:39 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:15:39 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:15:39 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:15:39 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:15:39 user nova-compute[74959]:   </clock>
Nov 28 23:15:39 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:15:39 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:15:39 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:15:39 user nova-compute[74959]:   </cpu>
Nov 28 23:15:39 user nova-compute[74959]:   <devices>
Nov 28 23:15:39 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:15:39 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:15:39 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk"/>
Nov 28 23:15:39 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:15:39 user nova-compute[74959]:     </disk>
Nov 28 23:15:39 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:15:39 user nova-compute[74959]:       <mac address="fa:16:3e:df:f5:d8"/>
Nov 28 23:15:39 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:15:39 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:15:39 user nova-compute[74959]:       <target dev="tapa2a17a6c-2c"/>
Nov 28 23:15:39 user nova-compute[74959]:     </interface>
Nov 28 23:15:39 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:15:39 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/console.log" append="off"/>
Nov 28 23:15:39 user nova-compute[74959]:     </serial>
Nov 28 23:15:39 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:15:39 user nova-compute[74959]:     <video>
Nov 28 23:15:39 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:15:39 user nova-compute[74959]:     </video>
Nov 28 23:15:39 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:15:39 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:15:39 user nova-compute[74959]:     </rng>
Nov 28 23:15:39 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:15:39 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:15:39 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:15:39 user nova-compute[74959]:     </memballoon>
Nov 28 23:15:39 user nova-compute[74959]:   </devices>
Nov 28 23:15:39 user nova-compute[74959]: </domain>
Nov 28 23:15:39 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1541535247',display_name='tempest-TestMinimumBasicScenario-server-1541535247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1541535247',id=36,image_ref='5043ed02-2334-4e3d-88aa-8c981af72663',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4CzHNiRuySWSAK+eIKs6fm1TVCxQ9WzZc5P+ymVAtljef1RJckew0PIYOFxhMU+2wPhZDs1v966+XQ4w3F6XirgpFdgkgH3+mThCFMFP6RgcC5bpOPww69rcm5YUrSAw==',key_name='tempest-TestMinimumBasicScenario-1531585152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-xo6rn83t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5043ed02-2334-4e3d-88aa-8c981af72663',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:15:37Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=2704bdaf-e70f-469e-9e88-b711b229dd6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f5:d8,bridge_name='br-int',has_traffic_filtering=True,id=a2a17a6c-2cde-4c06-bba8-23c3390260e3,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a17a6c-2c') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG os_vif [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f5:d8,bridge_name='br-int',has_traffic_filtering=True,id=a2a17a6c-2cde-4c06-bba8-23c3390260e3,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a17a6c-2c') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f3b8895-3dcb-59eb-a10c-93645b1dc887', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2a17a6c-2c, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2a17a6c-2c, col_values=(('qos', UUID('d6bc3372-576f-45ed-90e1-821a5d71a253')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2a17a6c-2c, col_values=(('external_ids', {'iface-id': 'a2a17a6c-2cde-4c06-bba8-23c3390260e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:f5:d8', 'vm-uuid': '2704bdaf-e70f-469e-9e88-b711b229dd6b'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:39 user nova-compute[74959]: INFO os_vif [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f5:d8,bridge_name='br-int',has_traffic_filtering=True,id=a2a17a6c-2cde-4c06-bba8-23c3390260e3,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a17a6c-2c')
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No VIF found with MAC fa:16:3e:df:f5:d8, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-afd20f35-28a6-4b65-b167-f769dab25c9e req-25cc85d9-d018-4aa6-aa7a-57937da16aac service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updated VIF entry in instance network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-afd20f35-28a6-4b65-b167-f769dab25c9e req-25cc85d9-d018-4aa6-aa7a-57937da16aac service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:15:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-afd20f35-28a6-4b65-b167-f769dab25c9e req-25cc85d9-d018-4aa6-aa7a-57937da16aac service nova] Releasing lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:15:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-4c9421e1-9e1f-459b-b175-c0a10df0d265 req-5793b755-4467-468f-82c5-b086c9d63d0f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4c9421e1-9e1f-459b-b175-c0a10df0d265 req-5793b755-4467-468f-82c5-b086c9d63d0f service nova] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4c9421e1-9e1f-459b-b175-c0a10df0d265 req-5793b755-4467-468f-82c5-b086c9d63d0f service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4c9421e1-9e1f-459b-b175-c0a10df0d265 req-5793b755-4467-468f-82c5-b086c9d63d0f service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-4c9421e1-9e1f-459b-b175-c0a10df0d265 req-5793b755-4467-468f-82c5-b086c9d63d0f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] No waiting events found dispatching network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:41 user nova-compute[74959]: WARNING nova.compute.manager [req-4c9421e1-9e1f-459b-b175-c0a10df0d265 req-5793b755-4467-468f-82c5-b086c9d63d0f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received unexpected event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 for instance with vm_state building and task_state spawning.
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:15:43 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Instance spawned successfully.
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-d3198c81-cacd-4c95-82a0-d28264738f28 req-fe22dc78-43ba-4d3b-b133-e080f09d1843 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d3198c81-cacd-4c95-82a0-d28264738f28 req-fe22dc78-43ba-4d3b-b133-e080f09d1843 service nova] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d3198c81-cacd-4c95-82a0-d28264738f28 req-fe22dc78-43ba-4d3b-b133-e080f09d1843 service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d3198c81-cacd-4c95-82a0-d28264738f28 req-fe22dc78-43ba-4d3b-b133-e080f09d1843 service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-d3198c81-cacd-4c95-82a0-d28264738f28 req-fe22dc78-43ba-4d3b-b133-e080f09d1843 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] No waiting events found dispatching network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:43 user nova-compute[74959]: WARNING nova.compute.manager [req-d3198c81-cacd-4c95-82a0-d28264738f28 req-fe22dc78-43ba-4d3b-b133-e080f09d1843 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received unexpected event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 for instance with vm_state building and task_state spawning.
Nov 28 23:15:43 user nova-compute[74959]: INFO nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 28 23:15:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:15:43 user nova-compute[74959]: INFO nova.compute.manager [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Took 7.17 seconds to build instance.
Nov 28 23:15:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-cfe2682a-fb35-4c6b-b8a7-43344fce660d tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.276s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:15:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:15:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:15:44 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:15:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updating instance_info_cache with network_info: [{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:15:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:15:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:15:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:15:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:15:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:15:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7312MB free_disk=24.73290252685547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 16ec5cae-3d8c-427b-a117-e0b8be34be5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 97925529-42d3-45de-af1b-be5df85c70e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 4645bea5-5301-4394-9ad8-0bc352a99dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 79fface9-6208-4ed9-82dc-800dc7f25364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 2704bdaf-e70f-469e-9e88-b711b229dd6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:58 user nova-compute[74959]: INFO nova.compute.manager [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Terminating instance
Nov 28 23:15:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-88164be0-862c-4175-a3c9-510e2da9db09 req-56ca9965-b1b2-468b-9ffe-f57c4ea13310 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-88164be0-862c-4175-a3c9-510e2da9db09 req-56ca9965-b1b2-468b-9ffe-f57c4ea13310 service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-88164be0-862c-4175-a3c9-510e2da9db09 req-56ca9965-b1b2-468b-9ffe-f57c4ea13310 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-88164be0-862c-4175-a3c9-510e2da9db09 req-56ca9965-b1b2-468b-9ffe-f57c4ea13310 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-88164be0-862c-4175-a3c9-510e2da9db09 req-56ca9965-b1b2-468b-9ffe-f57c4ea13310 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.compute.manager [req-88164be0-862c-4175-a3c9-510e2da9db09 req-56ca9965-b1b2-468b-9ffe-f57c4ea13310 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-unplugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:15:59 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Instance destroyed successfully.
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.objects.instance [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lazy-loading 'resources' on Instance uuid 63d3691b-4d3d-44ca-ab1a-d778d1ac7304 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-797958720',display_name='tempest-ServerStableDeviceRescueTest-server-797958720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-797958720',id=27,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwpnuwk3F4oQOUbvbeGHOHg77Y/1jNiciJERi9Nm37f3eKJeduzJ0yri0a7jRnXZu7o/hUCC83uhYv5J9OiUjya4c2oW4ivMUnAHM0Wmu33P6ssYkmPZv/AMPgZRp/Rpw==',key_name='tempest-keypair-138360968',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c8c0790fe9a4457aec8ddcc8630f2ec',ramdisk_id='',reservation_id='r-almgevc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-366574212',owner_user_name='tempest-ServerStableDeviceRescueTest-366574212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74e434d4b70f4c95be8af313a665e7af',uuid=63d3691b-4d3d-44ca-ab1a-d778d1ac7304,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Converting VIF {"id": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "address": "fa:16:3e:59:a3:92", "network": {"id": "0e2291ed-66eb-4e96-9c11-f39100518417", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1691592724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c8c0790fe9a4457aec8ddcc8630f2ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc897ce7f-6b", "ovs_interfaceid": "c897ce7f-6b41-4c61-9e90-56577c38cac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:a3:92,bridge_name='br-int',has_traffic_filtering=True,id=c897ce7f-6b41-4c61-9e90-56577c38cac7,network=Network(0e2291ed-66eb-4e96-9c11-f39100518417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc897ce7f-6b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG os_vif [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:a3:92,bridge_name='br-int',has_traffic_filtering=True,id=c897ce7f-6b41-4c61-9e90-56577c38cac7,network=Network(0e2291ed-66eb-4e96-9c11-f39100518417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc897ce7f-6b') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc897ce7f-6b, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7971328e-7f29-4e67-93bf-2fc1642bc0eb) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:15:59 user nova-compute[74959]: INFO os_vif [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:a3:92,bridge_name='br-int',has_traffic_filtering=True,id=c897ce7f-6b41-4c61-9e90-56577c38cac7,network=Network(0e2291ed-66eb-4e96-9c11-f39100518417),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc897ce7f-6b')
Nov 28 23:15:59 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Deleting instance files /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304_del
Nov 28 23:15:59 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Deletion of /opt/stack/data/nova/instances/63d3691b-4d3d-44ca-ab1a-d778d1ac7304_del complete
Nov 28 23:15:59 user nova-compute[74959]: INFO nova.compute.manager [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 23:15:59 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:15:59 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:16:00 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:16:00 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Took 0.86 seconds to deallocate network for instance.
Nov 28 23:16:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-4b2b3bdd-dea8-4a03-bc2b-9c590cca2947 req-f0b72261-a27e-40ea-85bc-8af78d906445 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-deleted-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:00 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:16:00 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:16:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:00 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Deleted allocations for instance 63d3691b-4d3d-44ca-ab1a-d778d1ac7304
Nov 28 23:16:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6ae195fe-9cad-4420-bbcf-f95e156a1d6b tempest-ServerStableDeviceRescueTest-366574212 tempest-ServerStableDeviceRescueTest-366574212-project-member] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.325s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-18851e0f-4e33-449f-8c83-00383dcd6368 req-37611532-2752-4f8a-91ef-2c07380229c3 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18851e0f-4e33-449f-8c83-00383dcd6368 req-37611532-2752-4f8a-91ef-2c07380229c3 service nova] Acquiring lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18851e0f-4e33-449f-8c83-00383dcd6368 req-37611532-2752-4f8a-91ef-2c07380229c3 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18851e0f-4e33-449f-8c83-00383dcd6368 req-37611532-2752-4f8a-91ef-2c07380229c3 service nova] Lock "63d3691b-4d3d-44ca-ab1a-d778d1ac7304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:01 user nova-compute[74959]: DEBUG nova.compute.manager [req-18851e0f-4e33-449f-8c83-00383dcd6368 req-37611532-2752-4f8a-91ef-2c07380229c3 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] No waiting events found dispatching network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:01 user nova-compute[74959]: WARNING nova.compute.manager [req-18851e0f-4e33-449f-8c83-00383dcd6368 req-37611532-2752-4f8a-91ef-2c07380229c3 service nova] [instance: 63d3691b-4d3d-44ca-ab1a-d778d1ac7304] Received unexpected event network-vif-plugged-c897ce7f-6b41-4c61-9e90-56577c38cac7 for instance with vm_state deleted and task_state None.
Nov 28 23:16:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 6a4c9cc3-e1c2-4963-8848-d52db32ae85e {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 6fec8c4d-2054-434e-b869-3f42ba7233c2 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 79fface9-6208-4ed9-82dc-800dc7f25364 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 2704bdaf-e70f-469e-9e88-b711b229dd6b {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 97925529-42d3-45de-af1b-be5df85c70e3 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "e245a015-fc98-4557-8168-5089c3746e79" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "97925529-42d3-45de-af1b-be5df85c70e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "e245a015-fc98-4557-8168-5089c3746e79" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "97925529-42d3-45de-af1b-be5df85c70e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:04 user nova-compute[74959]: INFO nova.compute.manager [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Detaching volume 983a6944-8ac4-4719-a4c4-210f07cc0d28
Nov 28 23:16:04 user nova-compute[74959]: INFO nova.virt.block_device [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Attempting to driver detach volume 983a6944-8ac4-4719-a4c4-210f07cc0d28 from mountpoint /dev/vdb
Nov 28 23:16:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Attempting to detach device vdb from instance 97925529-42d3-45de-af1b-be5df85c70e3 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:16:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:16:04 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:16:04 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:16:04 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:16:04 user nova-compute[74959]:   <serial>983a6944-8ac4-4719-a4c4-210f07cc0d28</serial>
Nov 28 23:16:04 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 23:16:04 user nova-compute[74959]: </disk>
Nov 28 23:16:04 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:16:04 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully detached device vdb from instance 97925529-42d3-45de-af1b-be5df85c70e3 from the persistent domain config.
Nov 28 23:16:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97925529-42d3-45de-af1b-be5df85c70e3 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:16:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:16:04 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:16:04 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:16:04 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:16:04 user nova-compute[74959]:   <serial>983a6944-8ac4-4719-a4c4-210f07cc0d28</serial>
Nov 28 23:16:04 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 23:16:04 user nova-compute[74959]: </disk>
Nov 28 23:16:04 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:16:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97925529-42d3-45de-af1b-be5df85c70e3 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:16:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97925529-42d3-45de-af1b-be5df85c70e3 is timed out.
Nov 28 23:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully detached device vdb from instance 97925529-42d3-45de-af1b-be5df85c70e3 from the live domain config.
Nov 28 23:16:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcuwMtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:16:24 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:16:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e49afb8-c865-4bf3-9921-2a08f04b4712]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b05791a3-af2e-4d65-a780-9e169c862d17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:16:24 user nova-compute[74959]: No targets found.
Nov 28 23:16:24 user nova-compute[74959]: iSNS:
Nov 28 23:16:24 user nova-compute[74959]: No targets found.
Nov 28 23:16:24 user nova-compute[74959]: STATIC:
Nov 28 23:16:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28
Nov 28 23:16:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:16:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:16:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c
Nov 28 23:16:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:16:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:16:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:16:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:16:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:16:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:b05791a3-af2e-4d65-a780-9e169c862d17
Nov 28 23:16:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:16:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:16:24 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:16:24 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:16:24 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:16:24 user nova-compute[74959]: FIRMWARE:
Nov 28 23:16:24 user nova-compute[74959]: No targets found.
Nov 28 23:16:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:16:24 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:16:24 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff801a49-d74c-4e3d-9de9-066acce5fbbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b05791a3-af2e-4d65-a780-9e169c862d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9a2a7c-644d-4c00-a04e-4a3cd741303a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b05791a3-af2e-4d65-a780-9e169c862d17 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:16:24 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:16:24 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:16:24 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:16:24 user nova-compute[74959]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b05791a3-af2e-4d65-a780-9e169c862d17 (non-flash)
Nov 28 23:16:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:16:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:16:24 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:16:24 user nova-compute[74959]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 (non-flash)
Nov 28 23:16:24 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:16:24 user nova-compute[74959]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b05791a3-af2e-4d65-a780-9e169c862d17 (non-flash)
Nov 28 23:16:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef47e7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f120872-9160-4ffa-b9dc-8ad2065cf67a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b06132-ac99-4996-bb11-e88197c2bcf1]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ada58-aaad-4b83-b5d5-794c8e4b1a29]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c047f4d-06da-45f9-a107-5c94227b1cb7]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f5117a-12a4-4010-87cd-583aecffc737]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59afd68-c7d0-4749-9eaf-7581abb4a720]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260]
Nov 28 23:16:25 user nova-compute[74959]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28, portal: 172.16.0.220,3260] successful.
Nov 28 23:16:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:983a6944-8ac4-4719-a4c4-210f07cc0d28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc962b-da1c-444c-9e1e-7e157a7ef0f2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== disconnect_volume: return (338ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:16:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:16:26 user nova-compute[74959]: DEBUG nova.objects.instance [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'flavor' on Instance uuid 97925529-42d3-45de-af1b-be5df85c70e3 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:16:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-32369e3c-6eae-44a4-abec-aefffc5d466c tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:16:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:39 user nova-compute[74959]: INFO nova.compute.manager [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Terminating instance
Nov 28 23:16:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-230bc14f-ae12-4175-9418-e95a374f5f6f req-07c84e88-330b-4506-8cd7-ee3bdcf9d0a8 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-230bc14f-ae12-4175-9418-e95a374f5f6f req-07c84e88-330b-4506-8cd7-ee3bdcf9d0a8 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-230bc14f-ae12-4175-9418-e95a374f5f6f req-07c84e88-330b-4506-8cd7-ee3bdcf9d0a8 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-230bc14f-ae12-4175-9418-e95a374f5f6f req-07c84e88-330b-4506-8cd7-ee3bdcf9d0a8 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-230bc14f-ae12-4175-9418-e95a374f5f6f req-07c84e88-330b-4506-8cd7-ee3bdcf9d0a8 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.compute.manager [req-230bc14f-ae12-4175-9418-e95a374f5f6f req-07c84e88-330b-4506-8cd7-ee3bdcf9d0a8 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-unplugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:16:40 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Instance destroyed successfully.
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'resources' on Instance uuid 16ec5cae-3d8c-427b-a117-e0b8be34be5f {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:11:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-246858674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-246858674',id=31,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:13:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-90m40xs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:14:54Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=16ec5cae-3d8c-427b-a117-e0b8be34be5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "address": "fa:16:3e:66:32:08", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47fc4ac0-57", "ovs_interfaceid": "47fc4ac0-57b6-463f-b77d-daa68b8abdeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:32:08,bridge_name='br-int',has_traffic_filtering=True,id=47fc4ac0-57b6-463f-b77d-daa68b8abdeb,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc4ac0-57') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_vif [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:32:08,bridge_name='br-int',has_traffic_filtering=True,id=47fc4ac0-57b6-463f-b77d-daa68b8abdeb,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc4ac0-57') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47fc4ac0-57, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e5d0045-3887-4d32-be2d-653f63249477) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:40 user nova-compute[74959]: INFO os_vif [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:32:08,bridge_name='br-int',has_traffic_filtering=True,id=47fc4ac0-57b6-463f-b77d-daa68b8abdeb,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47fc4ac0-57')
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiZhgvEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:16:40 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cb6391-45d0-42af-a8cb-cbc332154bdb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:16:40 user nova-compute[74959]: No targets found.
Nov 28 23:16:40 user nova-compute[74959]: iSNS:
Nov 28 23:16:40 user nova-compute[74959]: No targets found.
Nov 28 23:16:40 user nova-compute[74959]: STATIC:
Nov 28 23:16:40 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c
Nov 28 23:16:40 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:16:40 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:16:40 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49
Nov 28 23:16:40 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:16:40 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:16:40 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:16:40 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:16:40 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:16:40 user nova-compute[74959]: FIRMWARE:
Nov 28 23:16:40 user nova-compute[74959]: No targets found.
Nov 28 23:16:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:16:40 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:16:40 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe794cd-2034-42df-bf46-56ee34d6ca4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5cd509-024f-4186-b6b7-e9b17b92b7a0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:16:40 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:16:40 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:16:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:16:40 user nova-compute[74959]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 (non-flash)
Nov 28 23:16:40 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:16:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec365c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49'): ({'sdd'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Removing single pathed devices sdd {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7074b4f-5513-455e-9a50-605e4a340f90]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47a9044-a173-40ef-8f68-1be96d64d6ad]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flushing IO for device /dev/sdd {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[002703a8-ead2-4269-a40c-b4a5ea157256]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffe9226-f12a-4b32-866b-b1a1f8899809]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd53c9878-6cdcbbad0ad1f18f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d53c9878', '/dev/disk/by-id/scsi-23663646362626164') {{(pid=86637) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87b32a3-0edf-44cb-832a-ade5a133689b]: (4, None) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde951be-b940-4edd-a794-4ce80a1bc3fe]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d85463-83d5-4cf9-8f65-6f238cc88be2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49, portal: 172.16.0.220,3260]
Nov 28 23:16:40 user nova-compute[74959]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49, portal: 172.16.0.220,3260] successful.
Nov 28 23:16:40 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584501bf-b59a-43fd-ab2a-5dddfb514f49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[176c2fc2-3c75-46a5-a200-e4df8930918e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] <== disconnect_volume: return (387ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:16:40 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Deleting instance files /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f_del
Nov 28 23:16:40 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Deletion of /opt/stack/data/nova/instances/16ec5cae-3d8c-427b-a117-e0b8be34be5f_del complete
Nov 28 23:16:40 user nova-compute[74959]: INFO nova.compute.manager [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 28 23:16:40 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:16:40 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:16:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:41 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:16:41 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Took 0.57 seconds to deallocate network for instance.
Nov 28 23:16:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-c302ebe7-b8a5-4144-af61-0f83d0682d2f req-f792168c-61d2-4fe1-b711-e5deec46ed6c service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-deleted-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-d7c32e5f-a3de-4829-b43c-751aad8ff4e0 req-4c247f71-13a1-406e-8643-3f17b2a77346 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d7c32e5f-a3de-4829-b43c-751aad8ff4e0 req-4c247f71-13a1-406e-8643-3f17b2a77346 service nova] Acquiring lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d7c32e5f-a3de-4829-b43c-751aad8ff4e0 req-4c247f71-13a1-406e-8643-3f17b2a77346 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d7c32e5f-a3de-4829-b43c-751aad8ff4e0 req-4c247f71-13a1-406e-8643-3f17b2a77346 service nova] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-d7c32e5f-a3de-4829-b43c-751aad8ff4e0 req-4c247f71-13a1-406e-8643-3f17b2a77346 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] No waiting events found dispatching network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:42 user nova-compute[74959]: WARNING nova.compute.manager [req-d7c32e5f-a3de-4829-b43c-751aad8ff4e0 req-4c247f71-13a1-406e-8643-3f17b2a77346 service nova] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Received unexpected event network-vif-plugged-47fc4ac0-57b6-463f-b77d-daa68b8abdeb for instance with vm_state active and task_state deleting.
Nov 28 23:16:42 user nova-compute[74959]: INFO nova.compute.manager [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 16ec5cae-3d8c-427b-a117-e0b8be34be5f] Took 1.33 seconds to detach 1 volumes for instance.
Nov 28 23:16:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:43 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:16:43 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:16:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:43 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Deleted allocations for instance 16ec5cae-3d8c-427b-a117-e0b8be34be5f
Nov 28 23:16:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c95dc9fa-2f22-407c-8a5a-4ec8f3da6aa2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "16ec5cae-3d8c-427b-a117-e0b8be34be5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.728s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:16:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:16:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:16:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:16:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updating instance_info_cache with network_info: [{"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:16:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-82c0be4a-fbed-41e9-861b-c567fb67b696" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:16:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:16:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:50 user nova-compute[74959]: INFO nova.compute.manager [None req-be3c5d80-ef7f-46f1-acf9-883f7c9f154d tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Unrescuing
Nov 28 23:16:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be3c5d80-ef7f-46f1-acf9-883f7c9f154d tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:16:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be3c5d80-ef7f-46f1-acf9-883f7c9f154d tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquired lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:16:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-be3c5d80-ef7f-46f1-acf9-883f7c9f154d tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG nova.network.neutron [None req-be3c5d80-ef7f-46f1-acf9-883f7c9f154d tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-be3c5d80-ef7f-46f1-acf9-883f7c9f154d tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Releasing lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG nova.objects.instance [None req-be3c5d80-ef7f-46f1-acf9-883f7c9f154d tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'flavor' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-4156cd50-b0da-4dc2-9cd2-1f900a3cc666 req-b541c192-85ef-4e15-a818-0ad6e4474aab service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4156cd50-b0da-4dc2-9cd2-1f900a3cc666 req-b541c192-85ef-4e15-a818-0ad6e4474aab service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4156cd50-b0da-4dc2-9cd2-1f900a3cc666 req-b541c192-85ef-4e15-a818-0ad6e4474aab service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4156cd50-b0da-4dc2-9cd2-1f900a3cc666 req-b541c192-85ef-4e15-a818-0ad6e4474aab service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-4156cd50-b0da-4dc2-9cd2-1f900a3cc666 req-b541c192-85ef-4e15-a818-0ad6e4474aab service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:51 user nova-compute[74959]: WARNING nova.compute.manager [req-4156cd50-b0da-4dc2-9cd2-1f900a3cc666 req-b541c192-85ef-4e15-a818-0ad6e4474aab service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:16:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance destroyed successfully.
Nov 28 23:16:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-f85a0f08-ecdc-4705-bbe4-8fc89ccb48f5 req-fb821ee8-040e-40ff-ad39-3504c75872c6 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f85a0f08-ecdc-4705-bbe4-8fc89ccb48f5 req-fb821ee8-040e-40ff-ad39-3504c75872c6 service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f85a0f08-ecdc-4705-bbe4-8fc89ccb48f5 req-fb821ee8-040e-40ff-ad39-3504c75872c6 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f85a0f08-ecdc-4705-bbe4-8fc89ccb48f5 req-fb821ee8-040e-40ff-ad39-3504c75872c6 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-f85a0f08-ecdc-4705-bbe4-8fc89ccb48f5 req-fb821ee8-040e-40ff-ad39-3504c75872c6 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:53 user nova-compute[74959]: WARNING nova.compute.manager [req-f85a0f08-ecdc-4705-bbe4-8fc89ccb48f5 req-fb821ee8-040e-40ff-ad39-3504c75872c6 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:16:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:54 user nova-compute[74959]: INFO nova.compute.manager [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Terminating instance
Nov 28 23:16:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-76a7c81c-80e9-4ff1-bdd8-37b5ae412e46 req-e9fadee4-56d1-4252-b3ce-09c4410b64b3 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-76a7c81c-80e9-4ff1-bdd8-37b5ae412e46 req-e9fadee4-56d1-4252-b3ce-09c4410b64b3 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-76a7c81c-80e9-4ff1-bdd8-37b5ae412e46 req-e9fadee4-56d1-4252-b3ce-09c4410b64b3 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-76a7c81c-80e9-4ff1-bdd8-37b5ae412e46 req-e9fadee4-56d1-4252-b3ce-09c4410b64b3 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-76a7c81c-80e9-4ff1-bdd8-37b5ae412e46 req-e9fadee4-56d1-4252-b3ce-09c4410b64b3 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-76a7c81c-80e9-4ff1-bdd8-37b5ae412e46 req-e9fadee4-56d1-4252-b3ce-09c4410b64b3 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Instance destroyed successfully.
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'resources' on Instance uuid 97925529-42d3-45de-af1b-be5df85c70e3 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T23:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1413169235',display_name='tempest-ServerActionsTestOtherA-server-79963409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1413169235',id=32,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdIoqmkvBna6Fv6ppa7qEeS6l1KBSr/ZyBTQ7THMwZctuzylt05K45+gXmZE4p1MmHrojrazd4igdKhE8hysq24F9wXqR6aGP7N8BCzHsubCBOyMJOIqKdYEs5cpfbyHw==',key_name='tempest-keypair-781582706',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:13:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-oykyumb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=97925529-42d3-45de-af1b-be5df85c70e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "cfe2d164-f283-4339-a4ea-8732b732ce64", "address": "fa:16:3e:49:d5:64", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfe2d164-f2", "ovs_interfaceid": "cfe2d164-f283-4339-a4ea-8732b732ce64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG os_vif [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfe2d164-f2, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28be5d53-8348-4226-bdd0-3de26c10ac0c) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: INFO os_vif [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:d5:64,bridge_name='br-int',has_traffic_filtering=True,id=cfe2d164-f283-4339-a4ea-8732b732ce64,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfe2d164-f2')
Nov 28 23:16:55 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Deleting instance files /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3_del
Nov 28 23:16:55 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Deletion of /opt/stack/data/nova/instances/97925529-42d3-45de-af1b-be5df85c70e3_del complete
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:55 user nova-compute[74959]: INFO nova.compute.manager [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:56 user nova-compute[74959]: WARNING nova.compute.manager [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:56 user nova-compute[74959]: WARNING nova.compute.manager [req-6e389083-f1f9-41bd-aa52-a6e60b9acdf3 req-6d568ed6-f145-4713-b7b9-3315a7e28b0c service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state rescued and task_state unrescuing.
Nov 28 23:16:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-be3c5d80-ef7f-46f1-acf9-883f7c9f154d tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:16:56 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Took 0.80 seconds to deallocate network for instance.
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-83e132be-a057-42bc-a0cf-7ac74eda8710 req-93a16fd4-007b-4319-bd37-9c95d41b3245 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-deleted-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:56 user nova-compute[74959]: INFO nova.compute.manager [req-83e132be-a057-42bc-a0cf-7ac74eda8710 req-93a16fd4-007b-4319-bd37-9c95d41b3245 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Neutron deleted interface cfe2d164-f283-4339-a4ea-8732b732ce64; detaching it from the instance and deleting it from the info cache
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.network.neutron [req-83e132be-a057-42bc-a0cf-7ac74eda8710 req-93a16fd4-007b-4319-bd37-9c95d41b3245 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-83e132be-a057-42bc-a0cf-7ac74eda8710 req-93a16fd4-007b-4319-bd37-9c95d41b3245 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Detach interface failed, port_id=cfe2d164-f283-4339-a4ea-8732b732ce64, reason: Instance 97925529-42d3-45de-af1b-be5df85c70e3 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Error from libvirt while getting description of instance-00000020: [Error Code 42] Domain not found: no domain with matching uuid '97925529-42d3-45de-af1b-be5df85c70e3' (instance-00000020): libvirt.libvirtError: Domain not found: no domain with matching uuid '97925529-42d3-45de-af1b-be5df85c70e3' (instance-00000020)
Nov 28 23:16:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:57 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Deleted allocations for instance 97925529-42d3-45de-af1b-be5df85c70e3
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:57 user nova-compute[74959]: WARNING nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state deleted and task_state None.
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:57 user nova-compute[74959]: WARNING nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state deleted and task_state None.
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:57 user nova-compute[74959]: WARNING nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state deleted and task_state None.
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:57 user nova-compute[74959]: WARNING nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-unplugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state deleted and task_state None.
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Acquiring lock "97925529-42d3-45de-af1b-be5df85c70e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] Lock "97925529-42d3-45de-af1b-be5df85c70e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] No waiting events found dispatching network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:16:57 user nova-compute[74959]: WARNING nova.compute.manager [req-3433f34d-13ff-4744-8a0a-053bf89f4859 req-f6e614db-9e8a-4b7e-b20f-66ac91b92461 service nova] [instance: 97925529-42d3-45de-af1b-be5df85c70e3] Received unexpected event network-vif-plugged-cfe2d164-f283-4339-a4ea-8732b732ce64 for instance with vm_state deleted and task_state None.
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3428ce4-1c23-4afc-93bf-2d0fcc1ac7de tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "97925529-42d3-45de-af1b-be5df85c70e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.588s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:16:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:16:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:16:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=24.818042755126953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6fec8c4d-2054-434e-b869-3f42ba7233c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 4645bea5-5301-4394-9ad8-0bc352a99dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 79fface9-6208-4ed9-82dc-800dc7f25364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 2704bdaf-e70f-469e-9e88-b711b229dd6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:16:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "0992d274-8252-4601-8dc3-45e610eedc20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "0992d274-8252-4601-8dc3-45e610eedc20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:17:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:17:00 user nova-compute[74959]: INFO nova.compute.claims [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Claim successful on node user
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:17:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.policy [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22870bdb55a94a2c938fa2f4b663f09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970869d439544caa9fbc57b53c962c23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:17:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Creating image(s)
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "/opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "/opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "/opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk 1073741824" returned: 0 in 0.050s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.203s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Cannot resize image /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Ensure instance console log exists: /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Successfully created port: d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Successfully updated port: d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "refresh_cache-0992d274-8252-4601-8dc3-45e610eedc20" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquired lock "refresh_cache-0992d274-8252-4601-8dc3-45e610eedc20" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-b068812d-cc85-48f8-804c-c8b44c87ec20 req-7a37b9c0-f650-485b-a930-ade3c2ec8eb8 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received event network-changed-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-b068812d-cc85-48f8-804c-c8b44c87ec20 req-7a37b9c0-f650-485b-a930-ade3c2ec8eb8 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Refreshing instance network info cache due to event network-changed-d096953d-ca4e-4b2c-87b8-dea60bdbeb12. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b068812d-cc85-48f8-804c-c8b44c87ec20 req-7a37b9c0-f650-485b-a930-ade3c2ec8eb8 service nova] Acquiring lock "refresh_cache-0992d274-8252-4601-8dc3-45e610eedc20" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Updating instance_info_cache with network_info: [{"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Releasing lock "refresh_cache-0992d274-8252-4601-8dc3-45e610eedc20" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Instance network_info: |[{"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b068812d-cc85-48f8-804c-c8b44c87ec20 req-7a37b9c0-f650-485b-a930-ade3c2ec8eb8 service nova] Acquired lock "refresh_cache-0992d274-8252-4601-8dc3-45e610eedc20" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-b068812d-cc85-48f8-804c-c8b44c87ec20 req-7a37b9c0-f650-485b-a930-ade3c2ec8eb8 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Refreshing network info cache for port d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Start _get_guest_xml network_info=[{"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:17:03 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:17:03 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1891530339',display_name='tempest-VolumesActionsTest-instance-1891530339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1891530339',id=37,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='970869d439544caa9fbc57b53c962c23',ramdisk_id='',reservation_id='r-nh6ngdx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-209175437',owner_user_name='tempest-VolumesActionsTest-209175437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:17:01Z,user_data=None,user_id='22870bdb55a94a2c938fa2f4b663f09d',uuid=0992d274-8252-4601-8dc3-45e610eedc20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converting VIF {"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=d096953d-ca4e-4b2c-87b8-dea60bdbeb12,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd096953d-ca') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lazy-loading 'pci_devices' on Instance uuid 0992d274-8252-4601-8dc3-45e610eedc20 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:17:03 user nova-compute[74959]:   <uuid>0992d274-8252-4601-8dc3-45e610eedc20</uuid>
Nov 28 23:17:03 user nova-compute[74959]:   <name>instance-00000025</name>
Nov 28 23:17:03 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:17:03 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:17:03 user nova-compute[74959]:   <metadata>
Nov 28 23:17:03 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:17:03 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:17:03 user nova-compute[74959]:       <nova:name>tempest-VolumesActionsTest-instance-1891530339</nova:name>
Nov 28 23:17:03 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:17:03</nova:creationTime>
Nov 28 23:17:03 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:17:03 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:17:03 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:17:03 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:17:03 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:17:03 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:17:03 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:17:03 user nova-compute[74959]:       <nova:owner>
Nov 28 23:17:03 user nova-compute[74959]:         <nova:user uuid="22870bdb55a94a2c938fa2f4b663f09d">tempest-VolumesActionsTest-209175437-project-member</nova:user>
Nov 28 23:17:03 user nova-compute[74959]:         <nova:project uuid="970869d439544caa9fbc57b53c962c23">tempest-VolumesActionsTest-209175437</nova:project>
Nov 28 23:17:03 user nova-compute[74959]:       </nova:owner>
Nov 28 23:17:03 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:17:03 user nova-compute[74959]:       <nova:ports>
Nov 28 23:17:03 user nova-compute[74959]:         <nova:port uuid="d096953d-ca4e-4b2c-87b8-dea60bdbeb12">
Nov 28 23:17:03 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:17:03 user nova-compute[74959]:         </nova:port>
Nov 28 23:17:03 user nova-compute[74959]:       </nova:ports>
Nov 28 23:17:03 user nova-compute[74959]:     </nova:instance>
Nov 28 23:17:03 user nova-compute[74959]:   </metadata>
Nov 28 23:17:03 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:17:03 user nova-compute[74959]:     <system>
Nov 28 23:17:03 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:17:03 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:17:03 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:17:03 user nova-compute[74959]:       <entry name="serial">0992d274-8252-4601-8dc3-45e610eedc20</entry>
Nov 28 23:17:03 user nova-compute[74959]:       <entry name="uuid">0992d274-8252-4601-8dc3-45e610eedc20</entry>
Nov 28 23:17:03 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:17:03 user nova-compute[74959]:     </system>
Nov 28 23:17:03 user nova-compute[74959]:   </sysinfo>
Nov 28 23:17:03 user nova-compute[74959]:   <os>
Nov 28 23:17:03 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:17:03 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:17:03 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:17:03 user nova-compute[74959]:   </os>
Nov 28 23:17:03 user nova-compute[74959]:   <features>
Nov 28 23:17:03 user nova-compute[74959]:     <acpi/>
Nov 28 23:17:03 user nova-compute[74959]:     <apic/>
Nov 28 23:17:03 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:17:03 user nova-compute[74959]:   </features>
Nov 28 23:17:03 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:17:03 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:17:03 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:17:03 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:17:03 user nova-compute[74959]:   </clock>
Nov 28 23:17:03 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:17:03 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:17:03 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:17:03 user nova-compute[74959]:   </cpu>
Nov 28 23:17:03 user nova-compute[74959]:   <devices>
Nov 28 23:17:03 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:17:03 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:17:03 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk"/>
Nov 28 23:17:03 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:17:03 user nova-compute[74959]:     </disk>
Nov 28 23:17:03 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:17:03 user nova-compute[74959]:       <mac address="fa:16:3e:5c:f1:1e"/>
Nov 28 23:17:03 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:17:03 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:17:03 user nova-compute[74959]:       <target dev="tapd096953d-ca"/>
Nov 28 23:17:03 user nova-compute[74959]:     </interface>
Nov 28 23:17:03 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:17:03 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/console.log" append="off"/>
Nov 28 23:17:03 user nova-compute[74959]:     </serial>
Nov 28 23:17:03 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:17:03 user nova-compute[74959]:     <video>
Nov 28 23:17:03 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:17:03 user nova-compute[74959]:     </video>
Nov 28 23:17:03 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:17:03 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:17:03 user nova-compute[74959]:     </rng>
Nov 28 23:17:03 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:17:03 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:17:03 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:17:03 user nova-compute[74959]:     </memballoon>
Nov 28 23:17:03 user nova-compute[74959]:   </devices>
Nov 28 23:17:03 user nova-compute[74959]: </domain>
Nov 28 23:17:03 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1891530339',display_name='tempest-VolumesActionsTest-instance-1891530339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1891530339',id=37,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='970869d439544caa9fbc57b53c962c23',ramdisk_id='',reservation_id='r-nh6ngdx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-209175437',owner_user_name='tempest-VolumesActionsTest-209175437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:17:01Z,user_data=None,user_id='22870bdb55a94a2c938fa2f4b663f09d',uuid=0992d274-8252-4601-8dc3-45e610eedc20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converting VIF {"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=d096953d-ca4e-4b2c-87b8-dea60bdbeb12,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd096953d-ca') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG os_vif [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=d096953d-ca4e-4b2c-87b8-dea60bdbeb12,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd096953d-ca') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a14fb84-1155-5dd7-b0b5-4f4d658c47fb', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd096953d-ca, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd096953d-ca, col_values=(('qos', UUID('d72e2aae-ffc8-46c0-bc2a-afcc9f14b179')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd096953d-ca, col_values=(('external_ids', {'iface-id': 'd096953d-ca4e-4b2c-87b8-dea60bdbeb12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:f1:1e', 'vm-uuid': '0992d274-8252-4601-8dc3-45e610eedc20'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:03 user nova-compute[74959]: INFO os_vif [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=d096953d-ca4e-4b2c-87b8-dea60bdbeb12,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd096953d-ca')
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] No VIF found with MAC fa:16:3e:5c:f1:1e, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-b068812d-cc85-48f8-804c-c8b44c87ec20 req-7a37b9c0-f650-485b-a930-ade3c2ec8eb8 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Updated VIF entry in instance network info cache for port d096953d-ca4e-4b2c-87b8-dea60bdbeb12. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-b068812d-cc85-48f8-804c-c8b44c87ec20 req-7a37b9c0-f650-485b-a930-ade3c2ec8eb8 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Updating instance_info_cache with network_info: [{"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b068812d-cc85-48f8-804c-c8b44c87ec20 req-7a37b9c0-f650-485b-a930-ade3c2ec8eb8 service nova] Releasing lock "refresh_cache-0992d274-8252-4601-8dc3-45e610eedc20" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-06eaf8ec-c694-4853-a2de-b20903e95af7 req-df93990f-b01b-4ca4-86e0-6affd2ebbe9f service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received event network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06eaf8ec-c694-4853-a2de-b20903e95af7 req-df93990f-b01b-4ca4-86e0-6affd2ebbe9f service nova] Acquiring lock "0992d274-8252-4601-8dc3-45e610eedc20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06eaf8ec-c694-4853-a2de-b20903e95af7 req-df93990f-b01b-4ca4-86e0-6affd2ebbe9f service nova] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06eaf8ec-c694-4853-a2de-b20903e95af7 req-df93990f-b01b-4ca4-86e0-6affd2ebbe9f service nova] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-06eaf8ec-c694-4853-a2de-b20903e95af7 req-df93990f-b01b-4ca4-86e0-6affd2ebbe9f service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] No waiting events found dispatching network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:05 user nova-compute[74959]: WARNING nova.compute.manager [req-06eaf8ec-c694-4853-a2de-b20903e95af7 req-df93990f-b01b-4ca4-86e0-6affd2ebbe9f service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received unexpected event network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 for instance with vm_state building and task_state spawning.
Nov 28 23:17:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:17:07 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Instance spawned successfully.
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:07 user nova-compute[74959]: INFO nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-5689dc78-d8dc-46c5-bd21-b6be1ad1dc8c req-0449e7e4-9c37-482c-8be8-5327d9284219 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received event network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5689dc78-d8dc-46c5-bd21-b6be1ad1dc8c req-0449e7e4-9c37-482c-8be8-5327d9284219 service nova] Acquiring lock "0992d274-8252-4601-8dc3-45e610eedc20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5689dc78-d8dc-46c5-bd21-b6be1ad1dc8c req-0449e7e4-9c37-482c-8be8-5327d9284219 service nova] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5689dc78-d8dc-46c5-bd21-b6be1ad1dc8c req-0449e7e4-9c37-482c-8be8-5327d9284219 service nova] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-5689dc78-d8dc-46c5-bd21-b6be1ad1dc8c req-0449e7e4-9c37-482c-8be8-5327d9284219 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] No waiting events found dispatching network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:07 user nova-compute[74959]: WARNING nova.compute.manager [req-5689dc78-d8dc-46c5-bd21-b6be1ad1dc8c req-0449e7e4-9c37-482c-8be8-5327d9284219 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received unexpected event network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 for instance with vm_state building and task_state spawning.
Nov 28 23:17:07 user nova-compute[74959]: INFO nova.compute.manager [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Took 6.91 seconds to build instance.
Nov 28 23:17:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b250f7a9-339c-4ea1-9ad0-59eb0e14c051 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "0992d274-8252-4601-8dc3-45e610eedc20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.016s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-356d1fdd-5468-4d07-b8f7-ebafe6742495 req-f1b8f7b0-624c-4064-ad99-e0da0d5ef455 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received event network-changed-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-356d1fdd-5468-4d07-b8f7-ebafe6742495 req-f1b8f7b0-624c-4064-ad99-e0da0d5ef455 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Refreshing instance network info cache due to event network-changed-27594395-9f1d-495d-b4d9-744a7ab8f4e2. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-356d1fdd-5468-4d07-b8f7-ebafe6742495 req-f1b8f7b0-624c-4064-ad99-e0da0d5ef455 service nova] Acquiring lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-356d1fdd-5468-4d07-b8f7-ebafe6742495 req-f1b8f7b0-624c-4064-ad99-e0da0d5ef455 service nova] Acquired lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-356d1fdd-5468-4d07-b8f7-ebafe6742495 req-f1b8f7b0-624c-4064-ad99-e0da0d5ef455 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Refreshing network info cache for port 27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-356d1fdd-5468-4d07-b8f7-ebafe6742495 req-f1b8f7b0-624c-4064-ad99-e0da0d5ef455 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Updated VIF entry in instance network info cache for port 27594395-9f1d-495d-b4d9-744a7ab8f4e2. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-356d1fdd-5468-4d07-b8f7-ebafe6742495 req-f1b8f7b0-624c-4064-ad99-e0da0d5ef455 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Updating instance_info_cache with network_info: [{"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-356d1fdd-5468-4d07-b8f7-ebafe6742495 req-f1b8f7b0-624c-4064-ad99-e0da0d5ef455 service nova] Releasing lock "refresh_cache-79fface9-6208-4ed9-82dc-800dc7f25364" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:14 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'flavor' on Instance uuid 79fface9-6208-4ed9-82dc-800dc7f25364 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:17:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Ignoring supplied device name: /dev/vdb
Nov 28 23:17:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:14 user nova-compute[74959]: INFO nova.compute.manager [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Attaching volume 344533bb-dd07-4355-a17e-fd532b5730ff to /dev/vdb
Nov 28 23:17:15 user nova-compute[74959]: DEBUG os_brick.utils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bfe532-bbeb-455e-958f-03430c627bc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b8185-7028-44d0-ab4b-7a3b6e179edf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a136b6c1-9f3b-43b2-8848-235d9fdaabb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e1cac0-00ea-4a8a-94d0-37c25c399517]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:17:15 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:17:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[099ab0fe-bf66-4255-a9f4-0b2d8dfd2db8]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG os_brick.utils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:17:15 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Updating existing volume attachment record: 2d4610d2-216a-41b7-a173-b4b310f170db {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:17:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNKLXnYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:17:22 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:17:22 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:17:22 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5510c8cc-1a7c-4ff0-990b-b59295cbe611]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:17:22 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf714a49-744d-4f42-b281-46ee62b7fbc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff] added
Nov 28 23:17:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c653ad-63a4-4faf-a508-db615fe7ddb6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e43b3ff-ceb2-417b-a1de-512bb929d357]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNKLXnYT {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNKLXnYT" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b167ff-c4e5-4897-b5bc-13c1ce850397]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNKLXnYT'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe281b5-8a64-4244-aca4-86f5cb23c701]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee38c4b-02c6-421a-842a-c1fbd6fe4bf1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:17:22 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:17:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:17:22 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:17:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadcb129-0ed1-4e8e-a07b-1bc50586779f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff, portal: 172.16.0.220,3260]
Nov 28 23:17:22 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff, portal: 172.16.0.220,3260] successful.
Nov 28 23:17:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7877f7-67d5-40b7-8171-df8a97178d75]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[32faa188-c28f-4bca-8eec-9152048812f4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:17:22 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:17:22 user nova-compute[74959]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)
Nov 28 23:17:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:17:22 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:17:22 user nova-compute[74959]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)
Nov 28 23:17:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a49eae7-2c17-448d-9622-41c1c5ea11be]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:17:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNKLXnYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:17:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:17:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23663326137363637', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:17:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663326137363637', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'flavor' on Instance uuid 79fface9-6208-4ed9-82dc-800dc7f25364 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:17:24 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:17:24 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:17:24 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:17:24 user nova-compute[74959]:   <serial>344533bb-dd07-4355-a17e-fd532b5730ff</serial>
Nov 28 23:17:24 user nova-compute[74959]: </disk>
Nov 28 23:17:24 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No VIF found with MAC fa:16:3e:c7:87:00, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3f78590a-d303-43fa-b791-e78ee360cbf2 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.792s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:17:25 user nova-compute[74959]: INFO nova.compute.claims [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Claim successful on node user
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.network.neutron [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:17:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.policy [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '367ecd21410f4592ab3f54684cf4b74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1b6e9fa4f1453092f9640336ab087f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:17:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Creating image(s)
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "/opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "/opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "/opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk 1073741824" returned: 0 in 0.054s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Successfully created port: 258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Cannot resize image /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Ensure instance console log exists: /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Successfully updated port: 258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquired lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:26 user nova-compute[74959]: DEBUG nova.network.neutron [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-17fe1070-9519-48a8-a65c-ca7d0ba604bb req-0a2989f6-85e5-44c2-ad62-00515c4879f5 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received event network-changed-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-17fe1070-9519-48a8-a65c-ca7d0ba604bb req-0a2989f6-85e5-44c2-ad62-00515c4879f5 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Refreshing instance network info cache due to event network-changed-258fccdb-aa83-445c-ac76-c10826ff3fa9. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-17fe1070-9519-48a8-a65c-ca7d0ba604bb req-0a2989f6-85e5-44c2-ad62-00515c4879f5 service nova] Acquiring lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.neutron [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.neutron [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating instance_info_cache with network_info: [{"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Releasing lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Instance network_info: |[{"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-17fe1070-9519-48a8-a65c-ca7d0ba604bb req-0a2989f6-85e5-44c2-ad62-00515c4879f5 service nova] Acquired lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-17fe1070-9519-48a8-a65c-ca7d0ba604bb req-0a2989f6-85e5-44c2-ad62-00515c4879f5 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Refreshing network info cache for port 258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Start _get_guest_xml network_info=[{"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:17:27 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:17:27 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1314426489',display_name='tempest-SnapshotDataIntegrityTests-server-1314426489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1314426489',id=38,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCVFJyLkYJJjP5XubRL3qbaL4RoZMx1FpVuYZ1KR0onlhaqb78PTLQpH/PVqdkxpIuJ96ieUoG1UiSpbkXxEp4RHmrE7eZlNF+fY6PHvVAaRqDGvKjRg4JdKJBv/Ooa2Q==',key_name='tempest-keypair-441840350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d1b6e9fa4f1453092f9640336ab087f',ramdisk_id='',reservation_id='r-cyf97fgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-824424259',owner_user_name='tempest-SnapshotDataIntegrityTests-824424259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='367ecd21410f4592ab3f54684cf4b74c',uuid=15eae952-f2b9-4762-8daf-ef551b24931d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Converting VIF {"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:71:8b,bridge_name='br-int',has_traffic_filtering=True,id=258fccdb-aa83-445c-ac76-c10826ff3fa9,network=Network(967eb008-63ba-40aa-8523-ec5a9631e715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258fccdb-aa') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.objects.instance [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'pci_devices' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:17:27 user nova-compute[74959]:   <uuid>15eae952-f2b9-4762-8daf-ef551b24931d</uuid>
Nov 28 23:17:27 user nova-compute[74959]:   <name>instance-00000026</name>
Nov 28 23:17:27 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:17:27 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:17:27 user nova-compute[74959]:   <metadata>
Nov 28 23:17:27 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:17:27 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:17:27 user nova-compute[74959]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1314426489</nova:name>
Nov 28 23:17:27 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:17:27</nova:creationTime>
Nov 28 23:17:27 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:17:27 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:17:27 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:17:27 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:17:27 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:17:27 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:17:27 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:17:27 user nova-compute[74959]:       <nova:owner>
Nov 28 23:17:27 user nova-compute[74959]:         <nova:user uuid="367ecd21410f4592ab3f54684cf4b74c">tempest-SnapshotDataIntegrityTests-824424259-project-member</nova:user>
Nov 28 23:17:27 user nova-compute[74959]:         <nova:project uuid="4d1b6e9fa4f1453092f9640336ab087f">tempest-SnapshotDataIntegrityTests-824424259</nova:project>
Nov 28 23:17:27 user nova-compute[74959]:       </nova:owner>
Nov 28 23:17:27 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:17:27 user nova-compute[74959]:       <nova:ports>
Nov 28 23:17:27 user nova-compute[74959]:         <nova:port uuid="258fccdb-aa83-445c-ac76-c10826ff3fa9">
Nov 28 23:17:27 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 23:17:27 user nova-compute[74959]:         </nova:port>
Nov 28 23:17:27 user nova-compute[74959]:       </nova:ports>
Nov 28 23:17:27 user nova-compute[74959]:     </nova:instance>
Nov 28 23:17:27 user nova-compute[74959]:   </metadata>
Nov 28 23:17:27 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:17:27 user nova-compute[74959]:     <system>
Nov 28 23:17:27 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:17:27 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:17:27 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:17:27 user nova-compute[74959]:       <entry name="serial">15eae952-f2b9-4762-8daf-ef551b24931d</entry>
Nov 28 23:17:27 user nova-compute[74959]:       <entry name="uuid">15eae952-f2b9-4762-8daf-ef551b24931d</entry>
Nov 28 23:17:27 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:17:27 user nova-compute[74959]:     </system>
Nov 28 23:17:27 user nova-compute[74959]:   </sysinfo>
Nov 28 23:17:27 user nova-compute[74959]:   <os>
Nov 28 23:17:27 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:17:27 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:17:27 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:17:27 user nova-compute[74959]:   </os>
Nov 28 23:17:27 user nova-compute[74959]:   <features>
Nov 28 23:17:27 user nova-compute[74959]:     <acpi/>
Nov 28 23:17:27 user nova-compute[74959]:     <apic/>
Nov 28 23:17:27 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:17:27 user nova-compute[74959]:   </features>
Nov 28 23:17:27 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:17:27 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:17:27 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:17:27 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:17:27 user nova-compute[74959]:   </clock>
Nov 28 23:17:27 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:17:27 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:17:27 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:17:27 user nova-compute[74959]:   </cpu>
Nov 28 23:17:27 user nova-compute[74959]:   <devices>
Nov 28 23:17:27 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:17:27 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:17:27 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk"/>
Nov 28 23:17:27 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:17:27 user nova-compute[74959]:     </disk>
Nov 28 23:17:27 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:17:27 user nova-compute[74959]:       <mac address="fa:16:3e:49:71:8b"/>
Nov 28 23:17:27 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:17:27 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:17:27 user nova-compute[74959]:       <target dev="tap258fccdb-aa"/>
Nov 28 23:17:27 user nova-compute[74959]:     </interface>
Nov 28 23:17:27 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:17:27 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/console.log" append="off"/>
Nov 28 23:17:27 user nova-compute[74959]:     </serial>
Nov 28 23:17:27 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:17:27 user nova-compute[74959]:     <video>
Nov 28 23:17:27 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:17:27 user nova-compute[74959]:     </video>
Nov 28 23:17:27 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:17:27 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:17:27 user nova-compute[74959]:     </rng>
Nov 28 23:17:27 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:17:27 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:17:27 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:17:27 user nova-compute[74959]:     </memballoon>
Nov 28 23:17:27 user nova-compute[74959]:   </devices>
Nov 28 23:17:27 user nova-compute[74959]: </domain>
Nov 28 23:17:27 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1314426489',display_name='tempest-SnapshotDataIntegrityTests-server-1314426489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1314426489',id=38,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCVFJyLkYJJjP5XubRL3qbaL4RoZMx1FpVuYZ1KR0onlhaqb78PTLQpH/PVqdkxpIuJ96ieUoG1UiSpbkXxEp4RHmrE7eZlNF+fY6PHvVAaRqDGvKjRg4JdKJBv/Ooa2Q==',key_name='tempest-keypair-441840350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d1b6e9fa4f1453092f9640336ab087f',ramdisk_id='',reservation_id='r-cyf97fgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-824424259',owner_user_name='tempest-SnapshotDataIntegrityTests-824424259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='367ecd21410f4592ab3f54684cf4b74c',uuid=15eae952-f2b9-4762-8daf-ef551b24931d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Converting VIF {"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:71:8b,bridge_name='br-int',has_traffic_filtering=True,id=258fccdb-aa83-445c-ac76-c10826ff3fa9,network=Network(967eb008-63ba-40aa-8523-ec5a9631e715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258fccdb-aa') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG os_vif [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:71:8b,bridge_name='br-int',has_traffic_filtering=True,id=258fccdb-aa83-445c-ac76-c10826ff3fa9,network=Network(967eb008-63ba-40aa-8523-ec5a9631e715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258fccdb-aa') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b684d559-390b-5639-82a8-1847e06390d6', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap258fccdb-aa, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap258fccdb-aa, col_values=(('qos', UUID('5bf1c648-15a5-4a8e-8cc3-55871674541c')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap258fccdb-aa, col_values=(('external_ids', {'iface-id': '258fccdb-aa83-445c-ac76-c10826ff3fa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:71:8b', 'vm-uuid': '15eae952-f2b9-4762-8daf-ef551b24931d'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:27 user nova-compute[74959]: INFO os_vif [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:71:8b,bridge_name='br-int',has_traffic_filtering=True,id=258fccdb-aa83-445c-ac76-c10826ff3fa9,network=Network(967eb008-63ba-40aa-8523-ec5a9631e715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258fccdb-aa')
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No VIF found with MAC fa:16:3e:49:71:8b, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-17fe1070-9519-48a8-a65c-ca7d0ba604bb req-0a2989f6-85e5-44c2-ad62-00515c4879f5 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updated VIF entry in instance network info cache for port 258fccdb-aa83-445c-ac76-c10826ff3fa9. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG nova.network.neutron [req-17fe1070-9519-48a8-a65c-ca7d0ba604bb req-0a2989f6-85e5-44c2-ad62-00515c4879f5 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating instance_info_cache with network_info: [{"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-17fe1070-9519-48a8-a65c-ca7d0ba604bb req-0a2989f6-85e5-44c2-ad62-00515c4879f5 service nova] Releasing lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG nova.compute.manager [req-eb6e10c8-06e0-425d-a554-016153281f03 req-d0c94cc0-567e-4998-be9f-4846b7b94a0e service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received event network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eb6e10c8-06e0-425d-a554-016153281f03 req-d0c94cc0-567e-4998-be9f-4846b7b94a0e service nova] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eb6e10c8-06e0-425d-a554-016153281f03 req-d0c94cc0-567e-4998-be9f-4846b7b94a0e service nova] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eb6e10c8-06e0-425d-a554-016153281f03 req-d0c94cc0-567e-4998-be9f-4846b7b94a0e service nova] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG nova.compute.manager [req-eb6e10c8-06e0-425d-a554-016153281f03 req-d0c94cc0-567e-4998-be9f-4846b7b94a0e service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] No waiting events found dispatching network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:29 user nova-compute[74959]: WARNING nova.compute.manager [req-eb6e10c8-06e0-425d-a554-016153281f03 req-d0c94cc0-567e-4998-be9f-4846b7b94a0e service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received unexpected event network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 for instance with vm_state building and task_state spawning.
Nov 28 23:17:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:29 user nova-compute[74959]: DEBUG nova.objects.instance [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'flavor' on Instance uuid 2704bdaf-e70f-469e-9e88-b711b229dd6b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:30 user nova-compute[74959]: INFO nova.compute.manager [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Attaching volume 9e47e67d-b848-4532-879e-cbe75f4fdfe7 to /dev/vdb
Nov 28 23:17:30 user nova-compute[74959]: DEBUG os_brick.utils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99dd721-6d13-4914-b8fd-8c9b695772f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a375d684-c69d-447b-9e79-3cb4c79bef46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d5972-77e1-49fc-ba9e-2ec0407560eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e390c-5b02-41f9-8d33-b2ddd9412b19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:17:30 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c518094-cef6-42d5-9faf-a78408bab06b]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG os_brick.utils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating existing volume attachment record: 9f8e2b40-1892-4c10-8c96-30a802d5c32c {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:30 user nova-compute[74959]: INFO nova.compute.manager [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Terminating instance
Nov 28 23:17:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-4f5e6b86-6eac-436f-971c-3488f7ef0700 req-a782a56d-478a-4dfd-9187-d648dad05daa service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received event network-vif-unplugged-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f5e6b86-6eac-436f-971c-3488f7ef0700 req-a782a56d-478a-4dfd-9187-d648dad05daa service nova] Acquiring lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f5e6b86-6eac-436f-971c-3488f7ef0700 req-a782a56d-478a-4dfd-9187-d648dad05daa service nova] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f5e6b86-6eac-436f-971c-3488f7ef0700 req-a782a56d-478a-4dfd-9187-d648dad05daa service nova] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-4f5e6b86-6eac-436f-971c-3488f7ef0700 req-a782a56d-478a-4dfd-9187-d648dad05daa service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] No waiting events found dispatching network-vif-unplugged-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-4f5e6b86-6eac-436f-971c-3488f7ef0700 req-a782a56d-478a-4dfd-9187-d648dad05daa service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received event network-vif-unplugged-6f96a6be-156c-46df-bf7b-65e447d98df3 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Instance destroyed successfully.
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.objects.instance [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'resources' on Instance uuid 6fec8c4d-2054-434e-b869-3f42ba7233c2 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-601596130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-601596130',id=26,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:08:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-6u4u6025',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:10:04Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=6fec8c4d-2054-434e-b869-3f42ba7233c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "6f96a6be-156c-46df-bf7b-65e447d98df3", "address": "fa:16:3e:f5:c0:f6", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f96a6be-15", "ovs_interfaceid": "6f96a6be-156c-46df-bf7b-65e447d98df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:f6,bridge_name='br-int',has_traffic_filtering=True,id=6f96a6be-156c-46df-bf7b-65e447d98df3,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f96a6be-15') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG os_vif [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:f6,bridge_name='br-int',has_traffic_filtering=True,id=6f96a6be-156c-46df-bf7b-65e447d98df3,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f96a6be-15') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f96a6be-15, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed643f2a-bd10-4fc5-949a-ac6fad6553da) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:31 user nova-compute[74959]: INFO os_vif [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:f6,bridge_name='br-int',has_traffic_filtering=True,id=6f96a6be-156c-46df-bf7b-65e447d98df3,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f96a6be-15')
Nov 28 23:17:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Deleting instance files /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2_del
Nov 28 23:17:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Deletion of /opt/stack/data/nova/instances/6fec8c4d-2054-434e-b869-3f42ba7233c2_del complete
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:17:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Instance spawned successfully.
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:17:31 user nova-compute[74959]: INFO nova.compute.manager [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 28 23:17:31 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:17:31 user nova-compute[74959]: INFO nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-a25bb860-4ffd-486e-9e75-8978952229ec req-d310e146-71a5-40f7-83f0-abac9173a63e service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received event network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a25bb860-4ffd-486e-9e75-8978952229ec req-d310e146-71a5-40f7-83f0-abac9173a63e service nova] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a25bb860-4ffd-486e-9e75-8978952229ec req-d310e146-71a5-40f7-83f0-abac9173a63e service nova] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a25bb860-4ffd-486e-9e75-8978952229ec req-d310e146-71a5-40f7-83f0-abac9173a63e service nova] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-a25bb860-4ffd-486e-9e75-8978952229ec req-d310e146-71a5-40f7-83f0-abac9173a63e service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] No waiting events found dispatching network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:31 user nova-compute[74959]: WARNING nova.compute.manager [req-a25bb860-4ffd-486e-9e75-8978952229ec req-d310e146-71a5-40f7-83f0-abac9173a63e service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received unexpected event network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 for instance with vm_state building and task_state spawning.
Nov 28 23:17:31 user nova-compute[74959]: INFO nova.compute.manager [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Took 6.34 seconds to build instance.
Nov 28 23:17:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-202cfd08-0e7a-4cc1-bda4-673de6b205cf tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:31 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Took 0.47 seconds to deallocate network for instance.
Nov 28 23:17:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-29ddee19-b2da-427d-9675-af8ea7cd436e req-5e8459aa-42c1-4226-8b90-3dd23cc7a544 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received event network-vif-deleted-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:32 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:17:32 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:17:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:32 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Deleted allocations for instance 6fec8c4d-2054-434e-b869-3f42ba7233c2
Nov 28 23:17:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bcdbb590-07a9-4aff-9932-2a25380fb7d2 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.743s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-3f4e586d-3170-4201-9167-05cec9381aa6 req-2291217b-ef4e-49c2-bc90-690ce994e052 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received event network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3f4e586d-3170-4201-9167-05cec9381aa6 req-2291217b-ef4e-49c2-bc90-690ce994e052 service nova] Acquiring lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3f4e586d-3170-4201-9167-05cec9381aa6 req-2291217b-ef4e-49c2-bc90-690ce994e052 service nova] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3f4e586d-3170-4201-9167-05cec9381aa6 req-2291217b-ef4e-49c2-bc90-690ce994e052 service nova] Lock "6fec8c4d-2054-434e-b869-3f42ba7233c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-3f4e586d-3170-4201-9167-05cec9381aa6 req-2291217b-ef4e-49c2-bc90-690ce994e052 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] No waiting events found dispatching network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:32 user nova-compute[74959]: WARNING nova.compute.manager [req-3f4e586d-3170-4201-9167-05cec9381aa6 req-2291217b-ef4e-49c2-bc90-690ce994e052 service nova] [instance: 6fec8c4d-2054-434e-b869-3f42ba7233c2] Received unexpected event network-vif-plugged-6f96a6be-156c-46df-bf7b-65e447d98df3 for instance with vm_state deleted and task_state None.
Nov 28 23:17:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBLTrplY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:17:38 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:17:38 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:17:38 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb8a5e4-3040-4803-8839-8c3a2e4ee06e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:17:38 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd781901-280b-4dfa-83cb-0928fa10cdfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7] added
Nov 28 23:17:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[453786a5-c82f-4b30-8ab5-066242f9498e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb4fa07-ced2-42ff-83c5-eadb873e93f2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBLTrplY {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBLTrplY" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ad95ad-2c28-4144-8e0e-dc5694a37eac]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iBLTrplY'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d29a49-5d5d-456e-8d5d-541e7b1db196]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e0bb9-f3ca-42ad-8223-7f26676a73bf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)
Nov 28 23:17:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)
Nov 28 23:17:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d8b6a4-7dcf-49d5-ad5d-893c87b0688c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7, portal: 172.16.0.220,3260]
Nov 28 23:17:38 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7, portal: 172.16.0.220,3260] successful.
Nov 28 23:17:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[de730984-4acd-4f7b-821c-a360be7831de]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4808f0-8665-4008-a7f4-b94df7080c54]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:17:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)
Nov 28 23:17:38 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:17:38 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[50198ed0-2246-44d7-903b-02851e15edb5]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:17:38 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBLTrplY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:17:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:17:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23563363866336239', 'path': '/dev/sdd'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:17:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563363866336239', 'path': '/dev/sdd'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:17:39 user nova-compute[74959]: DEBUG nova.objects.instance [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'flavor' on Instance uuid 2704bdaf-e70f-469e-9e88-b711b229dd6b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:17:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:17:39 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:17:39 user nova-compute[74959]:   <source dev="/dev/sdd"/>
Nov 28 23:17:39 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:17:39 user nova-compute[74959]:   <serial>9e47e67d-b848-4532-879e-cbe75f4fdfe7</serial>
Nov 28 23:17:39 user nova-compute[74959]: </disk>
Nov 28 23:17:39 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:17:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:17:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:17:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] No VIF found with MAC fa:16:3e:df:f5:d8, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:17:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84439b5d-e449-4c1e-a865-1629b57906e0 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.999s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-0d740fee-9166-425e-a559-19fc8111a6d0 req-5e33b254-221e-4ea3-bb87-9e959e6650e3 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:43 user nova-compute[74959]: DEBUG nova.compute.manager [req-0d740fee-9166-425e-a559-19fc8111a6d0 req-5e33b254-221e-4ea3-bb87-9e959e6650e3 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing instance network info cache due to event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:17:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0d740fee-9166-425e-a559-19fc8111a6d0 req-5e33b254-221e-4ea3-bb87-9e959e6650e3 service nova] Acquiring lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0d740fee-9166-425e-a559-19fc8111a6d0 req-5e33b254-221e-4ea3-bb87-9e959e6650e3 service nova] Acquired lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:43 user nova-compute[74959]: DEBUG nova.network.neutron [req-0d740fee-9166-425e-a559-19fc8111a6d0 req-5e33b254-221e-4ea3-bb87-9e959e6650e3 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:17:43 user nova-compute[74959]: DEBUG nova.network.neutron [req-0d740fee-9166-425e-a559-19fc8111a6d0 req-5e33b254-221e-4ea3-bb87-9e959e6650e3 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updated VIF entry in instance network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:17:43 user nova-compute[74959]: DEBUG nova.network.neutron [req-0d740fee-9166-425e-a559-19fc8111a6d0 req-5e33b254-221e-4ea3-bb87-9e959e6650e3 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0d740fee-9166-425e-a559-19fc8111a6d0 req-5e33b254-221e-4ea3-bb87-9e959e6650e3 service nova] Releasing lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c6df21f-5fe0-44c2-9cd9-9008450b32b4 req-6e8062c9-74a5-42be-a4fe-0371aaf671b1 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c6df21f-5fe0-44c2-9cd9-9008450b32b4 req-6e8062c9-74a5-42be-a4fe-0371aaf671b1 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing instance network info cache due to event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c6df21f-5fe0-44c2-9cd9-9008450b32b4 req-6e8062c9-74a5-42be-a4fe-0371aaf671b1 service nova] Acquiring lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c6df21f-5fe0-44c2-9cd9-9008450b32b4 req-6e8062c9-74a5-42be-a4fe-0371aaf671b1 service nova] Acquired lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-8c6df21f-5fe0-44c2-9cd9-9008450b32b4 req-6e8062c9-74a5-42be-a4fe-0371aaf671b1 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:45 user nova-compute[74959]: INFO nova.compute.manager [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Detaching volume 344533bb-dd07-4355-a17e-fd532b5730ff
Nov 28 23:17:45 user nova-compute[74959]: INFO nova.virt.block_device [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Attempting to driver detach volume 344533bb-dd07-4355-a17e-fd532b5730ff from mountpoint /dev/vdb
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Attempting to detach device vdb from instance 79fface9-6208-4ed9-82dc-800dc7f25364 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:17:45 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:17:45 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:17:45 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:17:45 user nova-compute[74959]:   <serial>344533bb-dd07-4355-a17e-fd532b5730ff</serial>
Nov 28 23:17:45 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:17:45 user nova-compute[74959]: </disk>
Nov 28 23:17:45 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:17:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Successfully detached device vdb from instance 79fface9-6208-4ed9-82dc-800dc7f25364 from the persistent domain config.
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79fface9-6208-4ed9-82dc-800dc7f25364 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:17:45 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:17:45 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:17:45 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:17:45 user nova-compute[74959]:   <serial>344533bb-dd07-4355-a17e-fd532b5730ff</serial>
Nov 28 23:17:45 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:17:45 user nova-compute[74959]: </disk>
Nov 28 23:17:45 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-8c6df21f-5fe0-44c2-9cd9-9008450b32b4 req-6e8062c9-74a5-42be-a4fe-0371aaf671b1 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updated VIF entry in instance network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-8c6df21f-5fe0-44c2-9cd9-9008450b32b4 req-6e8062c9-74a5-42be-a4fe-0371aaf671b1 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c6df21f-5fe0-44c2-9cd9-9008450b32b4 req-6e8062c9-74a5-42be-a4fe-0371aaf671b1 service nova] Releasing lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79fface9-6208-4ed9-82dc-800dc7f25364 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:46 user nova-compute[74959]: INFO nova.compute.manager [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Rebooting instance
Nov 28 23:17:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquired lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG nova.network.neutron [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:17:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updating instance_info_cache with network_info: [{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:17:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:17:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Releasing lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:17:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-6940bc26-fcf6-496b-b769-47946aeaae60 req-1f2118b3-305b-445d-ba28-c043aff5c65c service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-unplugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6940bc26-fcf6-496b-b769-47946aeaae60 req-1f2118b3-305b-445d-ba28-c043aff5c65c service nova] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6940bc26-fcf6-496b-b769-47946aeaae60 req-1f2118b3-305b-445d-ba28-c043aff5c65c service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6940bc26-fcf6-496b-b769-47946aeaae60 req-1f2118b3-305b-445d-ba28-c043aff5c65c service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:49 user nova-compute[74959]: DEBUG nova.compute.manager [req-6940bc26-fcf6-496b-b769-47946aeaae60 req-1f2118b3-305b-445d-ba28-c043aff5c65c service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] No waiting events found dispatching network-vif-unplugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:49 user nova-compute[74959]: WARNING nova.compute.manager [req-6940bc26-fcf6-496b-b769-47946aeaae60 req-1f2118b3-305b-445d-ba28-c043aff5c65c service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received unexpected event network-vif-unplugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 for instance with vm_state active and task_state reboot_started.
Nov 28 23:17:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Instance shutdown successfully.
Nov 28 23:17:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-495808e3-8a41-4645-8c57-aa98d135af42 req-7a205af3-ad15-4c9e-8d57-904377a0361f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-495808e3-8a41-4645-8c57-aa98d135af42 req-7a205af3-ad15-4c9e-8d57-904377a0361f service nova] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-495808e3-8a41-4645-8c57-aa98d135af42 req-7a205af3-ad15-4c9e-8d57-904377a0361f service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-495808e3-8a41-4645-8c57-aa98d135af42 req-7a205af3-ad15-4c9e-8d57-904377a0361f service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-495808e3-8a41-4645-8c57-aa98d135af42 req-7a205af3-ad15-4c9e-8d57-904377a0361f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] No waiting events found dispatching network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:51 user nova-compute[74959]: WARNING nova.compute.manager [req-495808e3-8a41-4645-8c57-aa98d135af42 req-7a205af3-ad15-4c9e-8d57-904377a0361f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received unexpected event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 for instance with vm_state active and task_state reboot_started.
Nov 28 23:17:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] No waiting events found dispatching network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:53 user nova-compute[74959]: WARNING nova.compute.manager [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received unexpected event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 for instance with vm_state active and task_state reboot_started.
Nov 28 23:17:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] No waiting events found dispatching network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:17:53 user nova-compute[74959]: WARNING nova.compute.manager [req-5355ab09-7f23-4baa-893d-2b0c80511d2e req-7c3209c5-10b4-499a-ab1a-5fcd3f0d545e service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received unexpected event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 for instance with vm_state active and task_state reboot_started.
Nov 28 23:17:53 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Instance running successfully.
Nov 28 23:17:53 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Instance soft rebooted successfully.
Nov 28 23:17:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:17:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-6b2b5994-da6f-46c5-8198-5f2183d8b9af tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.595s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:17:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:17:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:18:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7679MB free_disk=24.90038299560547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance e245a015-fc98-4557-8168-5089c3746e79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 4645bea5-5301-4394-9ad8-0bc352a99dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 79fface9-6208-4ed9-82dc-800dc7f25364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 2704bdaf-e70f-469e-9e88-b711b229dd6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 0992d274-8252-4601-8dc3-45e610eedc20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 15eae952-f2b9-4762-8daf-ef551b24931d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:18:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 79fface9-6208-4ed9-82dc-800dc7f25364 is timed out.
Nov 28 23:18:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Successfully detached device vdb from instance 79fface9-6208-4ed9-82dc-800dc7f25364 from the live domain config.
Nov 28 23:18:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNKLXnYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:18:06 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e25f00-fd2f-4590-8f0a-13438679c2d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:18:06 user nova-compute[74959]: No targets found.
Nov 28 23:18:06 user nova-compute[74959]: iSNS:
Nov 28 23:18:06 user nova-compute[74959]: No targets found.
Nov 28 23:18:06 user nova-compute[74959]: STATIC:
Nov 28 23:18:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff
Nov 28 23:18:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7
Nov 28 23:18:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c
Nov 28 23:18:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:18:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:06 user nova-compute[74959]: FIRMWARE:
Nov 28 23:18:06 user nova-compute[74959]: No targets found.
Nov 28 23:18:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:18:06 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:18:06 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220ea08-23ec-4eb6-9eb0-f05e564ca690]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9ca1d-6533-4e94-99c2-c95e1086d27c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:18:06 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:18:06 user nova-compute[74959]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)
Nov 28 23:18:06 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:18:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:18:06 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:18:06 user nova-compute[74959]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff (non-flash)
Nov 28 23:18:06 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:18:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc79a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a833bdb-776d-496b-8f6c-ed9424d5fdfb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b91d75a-9166-400c-b780-52bf9ad2dcec]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6096e5a6-d86f-4993-9563-26fcb1249f4b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f62bb8-a147-4388-aa6b-8f7b07ee2402]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c74e9f-420b-4cc3-b55a-340333a1bc04]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[191d0bbe-baca-4dc7-8ef8-9849568a4479]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff, portal: 172.16.0.220,3260]
Nov 28 23:18:06 user nova-compute[74959]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff, portal: 172.16.0.220,3260] successful.
Nov 28 23:18:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f71525-3971-4960-9a46-e47641cf3e69]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] <== disconnect_volume: return (321ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:18:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG nova.objects.instance [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'flavor' on Instance uuid 79fface9-6208-4ed9-82dc-800dc7f25364 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-870b5e3d-68a9-4bdc-b9c6-5105221c660e tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.667s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.489s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:07 user nova-compute[74959]: INFO nova.compute.manager [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Terminating instance
Nov 28 23:18:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-c147eb97-c54f-4bab-8d35-b07f450e383d req-ef22d58f-1219-4d63-836b-c8f3b64f3eb7 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received event network-vif-unplugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c147eb97-c54f-4bab-8d35-b07f450e383d req-ef22d58f-1219-4d63-836b-c8f3b64f3eb7 service nova] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c147eb97-c54f-4bab-8d35-b07f450e383d req-ef22d58f-1219-4d63-836b-c8f3b64f3eb7 service nova] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c147eb97-c54f-4bab-8d35-b07f450e383d req-ef22d58f-1219-4d63-836b-c8f3b64f3eb7 service nova] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-c147eb97-c54f-4bab-8d35-b07f450e383d req-ef22d58f-1219-4d63-836b-c8f3b64f3eb7 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] No waiting events found dispatching network-vif-unplugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:18:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-c147eb97-c54f-4bab-8d35-b07f450e383d req-ef22d58f-1219-4d63-836b-c8f3b64f3eb7 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received event network-vif-unplugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:18:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Instance destroyed successfully.
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.objects.instance [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'resources' on Instance uuid 79fface9-6208-4ed9-82dc-800dc7f25364 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2041217511',display_name='tempest-VolumesSnapshotTestJSON-instance-2041217511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2041217511',id=35,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwNzBxAxqAznRZykuH0FZzgT7h/zOnBRQiSXpenyKQWQWMk9Vrub4UWZ0zIaQscvgrk4YftRNoW6xEIj9MU85kTG3G/9L7M1gxdPq/ILT8b2Me7jnp4tgOXIz0PP5cq+Q==',key_name='tempest-keypair-383029919',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:15:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4e44315cc7e42f3ac72740bfba170e4',ramdisk_id='',reservation_id='r-mosc75d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1119708422',owner_user_name='tempest-VolumesSnapshotTestJSON-1119708422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18a99b86ac9844fd8ad2329e41d22c65',uuid=79fface9-6208-4ed9-82dc-800dc7f25364,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converting VIF {"id": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "address": "fa:16:3e:c7:87:00", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27594395-9f", "ovs_interfaceid": "27594395-9f1d-495d-b4d9-744a7ab8f4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:87:00,bridge_name='br-int',has_traffic_filtering=True,id=27594395-9f1d-495d-b4d9-744a7ab8f4e2,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27594395-9f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_vif [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:87:00,bridge_name='br-int',has_traffic_filtering=True,id=27594395-9f1d-495d-b4d9-744a7ab8f4e2,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27594395-9f') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27594395-9f, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de974d29-263a-45da-bbf6-aec4e15821bd) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:08 user nova-compute[74959]: INFO os_vif [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:87:00,bridge_name='br-int',has_traffic_filtering=True,id=27594395-9f1d-495d-b4d9-744a7ab8f4e2,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27594395-9f')
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNKLXnYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:18:08 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6dcbf0-43de-4471-8794-61e8b4ab3868]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:18:08 user nova-compute[74959]: No targets found.
Nov 28 23:18:08 user nova-compute[74959]: iSNS:
Nov 28 23:18:08 user nova-compute[74959]: No targets found.
Nov 28 23:18:08 user nova-compute[74959]: STATIC:
Nov 28 23:18:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7
Nov 28 23:18:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c
Nov 28 23:18:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:18:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:08 user nova-compute[74959]: FIRMWARE:
Nov 28 23:18:08 user nova-compute[74959]: No targets found.
Nov 28 23:18:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:18:08 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:18:08 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:344533bb-dd07-4355-a17e-fd532b5730ff', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db5ea4-b003-4b4b-9de9-22bae336c2d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f53fbf-218b-431e-bd9a-7064975e411d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:18:08 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:18:08 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:18:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:18:08 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:18:08 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:18:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc79a950>, {}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Disconnecting from: [] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] <== disconnect_volume: return (68ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:18:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Deleting instance files /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364_del
Nov 28 23:18:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Deletion of /opt/stack/data/nova/instances/79fface9-6208-4ed9-82dc-800dc7f25364_del complete
Nov 28 23:18:08 user nova-compute[74959]: INFO nova.compute.manager [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 23:18:08 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:18:08 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:08 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Took 0.66 seconds to deallocate network for instance.
Nov 28 23:18:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-f0ed69cc-2edd-45cd-84a5-067effa277a9 req-49dad3bd-8e53-464b-a6f4-7f8aa97228c0 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received event network-vif-deleted-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:09 user nova-compute[74959]: WARNING nova.volume.cinder [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Attachment 2d4610d2-216a-41b7-a173-b4b310f170db does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2d4610d2-216a-41b7-a173-b4b310f170db. (HTTP 404) (Request-ID: req-e300722c-6f3f-4af2-b05a-4f4e861587e4)
Nov 28 23:18:09 user nova-compute[74959]: INFO nova.compute.manager [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 23:18:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:09 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Deleted allocations for instance 79fface9-6208-4ed9-82dc-800dc7f25364
Nov 28 23:18:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4a48f3a3-d594-4c87-a3ca-24ca184f23bb tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "79fface9-6208-4ed9-82dc-800dc7f25364" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-c649cd86-dbd8-4c1a-a5a1-5ffc47074e0f req-18aa11d8-4257-4187-912e-669494b21507 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received event network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c649cd86-dbd8-4c1a-a5a1-5ffc47074e0f req-18aa11d8-4257-4187-912e-669494b21507 service nova] Acquiring lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c649cd86-dbd8-4c1a-a5a1-5ffc47074e0f req-18aa11d8-4257-4187-912e-669494b21507 service nova] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c649cd86-dbd8-4c1a-a5a1-5ffc47074e0f req-18aa11d8-4257-4187-912e-669494b21507 service nova] Lock "79fface9-6208-4ed9-82dc-800dc7f25364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-c649cd86-dbd8-4c1a-a5a1-5ffc47074e0f req-18aa11d8-4257-4187-912e-669494b21507 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] No waiting events found dispatching network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:18:09 user nova-compute[74959]: WARNING nova.compute.manager [req-c649cd86-dbd8-4c1a-a5a1-5ffc47074e0f req-18aa11d8-4257-4187-912e-669494b21507 service nova] [instance: 79fface9-6208-4ed9-82dc-800dc7f25364] Received unexpected event network-vif-plugged-27594395-9f1d-495d-b4d9-744a7ab8f4e2 for instance with vm_state deleted and task_state None.
Nov 28 23:18:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "e245a015-fc98-4557-8168-5089c3746e79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:21 user nova-compute[74959]: INFO nova.compute.manager [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Terminating instance
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.compute.manager [req-d7026431-b1be-4e64-809e-e4dcaddd904e req-35cd94fd-3758-4ddc-84d3-1db0b1dc7927 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d7026431-b1be-4e64-809e-e4dcaddd904e req-35cd94fd-3758-4ddc-84d3-1db0b1dc7927 service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d7026431-b1be-4e64-809e-e4dcaddd904e req-35cd94fd-3758-4ddc-84d3-1db0b1dc7927 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d7026431-b1be-4e64-809e-e4dcaddd904e req-35cd94fd-3758-4ddc-84d3-1db0b1dc7927 service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.compute.manager [req-d7026431-b1be-4e64-809e-e4dcaddd904e req-35cd94fd-3758-4ddc-84d3-1db0b1dc7927 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.compute.manager [req-d7026431-b1be-4e64-809e-e4dcaddd904e req-35cd94fd-3758-4ddc-84d3-1db0b1dc7927 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-unplugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] Instance destroyed successfully.
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'resources' on Instance uuid e245a015-fc98-4557-8168-5089c3746e79 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1486772722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1486772722',id=15,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:04:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-vnxjucqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:06:21Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=e245a015-fc98-4557-8168-5089c3746e79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "address": "fa:16:3e:65:99:34", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7515dc9f-ea", "ovs_interfaceid": "7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:99:34,bridge_name='br-int',has_traffic_filtering=True,id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7515dc9f-ea') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_vif [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:99:34,bridge_name='br-int',has_traffic_filtering=True,id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7515dc9f-ea') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7515dc9f-ea, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41dca0d8-9218-400b-9894-e3f07f3a37bf) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: INFO os_vif [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:99:34,bridge_name='br-int',has_traffic_filtering=True,id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7515dc9f-ea')
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agoWCfzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:18:21 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb430f-3d68-4bb1-a49a-85b6630ed1ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:18:21 user nova-compute[74959]: No targets found.
Nov 28 23:18:21 user nova-compute[74959]: iSNS:
Nov 28 23:18:21 user nova-compute[74959]: No targets found.
Nov 28 23:18:21 user nova-compute[74959]: STATIC:
Nov 28 23:18:21 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7
Nov 28 23:18:21 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:21 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:21 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c
Nov 28 23:18:21 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:21 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:21 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106
Nov 28 23:18:21 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:18:21 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:18:21 user nova-compute[74959]: FIRMWARE:
Nov 28 23:18:21 user nova-compute[74959]: No targets found.
Nov 28 23:18:21 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:18:21 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:18:21 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d33db85-879c-4841-b774-3dac90db382c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f247d786-c438-483f-9ce6-804b16491f48]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:18:21 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:18:21 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:18:21 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 (non-flash)
Nov 28 23:18:21 user nova-compute[74959]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:18:21 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:18:21 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4134c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106'): ({'sdc'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Removing single pathed devices sdc {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb08c72-644f-4310-bde2-79d2923d340b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f1a9e-1a21-4277-ba24-0e1539699a09]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Flushing IO for device /dev/sdc {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b2b9a2-bb7e-4238-90d5-402010721bfb]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e5fb75-78b3-4a5b-acbc-5c04790b9fe1]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[af852fbd-758a-4eac-b610-dbc08ca42594]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2ce95e-4c95-4327-a1bb-7b5f84efc58b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106, portal: 172.16.0.220,3260]
Nov 28 23:18:21 user nova-compute[74959]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106, portal: 172.16.0.220,3260] successful.
Nov 28 23:18:21 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d040aa-729e-4f9c-bfe6-2ac14c0fa106 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b776b965-3b82-428d-a57d-9c79ce4d7459]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] <== disconnect_volume: return (308ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:18:21 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Deleting instance files /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79_del
Nov 28 23:18:21 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Deletion of /opt/stack/data/nova/instances/e245a015-fc98-4557-8168-5089c3746e79_del complete
Nov 28 23:18:21 user nova-compute[74959]: INFO nova.compute.manager [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 23:18:21 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:18:21 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:18:22 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:22 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: e245a015-fc98-4557-8168-5089c3746e79] Took 0.42 seconds to deallocate network for instance.
Nov 28 23:18:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-c4baa5a0-ce6a-4297-abdf-08143c4c3253 req-5e586b59-7e15-4ba1-b136-381aee025898 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-deleted-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:22 user nova-compute[74959]: INFO nova.compute.manager [req-c4baa5a0-ce6a-4297-abdf-08143c4c3253 req-5e586b59-7e15-4ba1-b136-381aee025898 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Neutron deleted interface 7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0; detaching it from the instance and deleting it from the info cache
Nov 28 23:18:22 user nova-compute[74959]: DEBUG nova.network.neutron [req-c4baa5a0-ce6a-4297-abdf-08143c4c3253 req-5e586b59-7e15-4ba1-b136-381aee025898 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-c4baa5a0-ce6a-4297-abdf-08143c4c3253 req-5e586b59-7e15-4ba1-b136-381aee025898 service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Detach interface failed, port_id=7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0, reason: Instance e245a015-fc98-4557-8168-5089c3746e79 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:18:23 user nova-compute[74959]: INFO nova.compute.manager [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: e245a015-fc98-4557-8168-5089c3746e79] Took 0.83 seconds to detach 1 volumes for instance.
Nov 28 23:18:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-526de792-1f81-4aae-8864-943092e6218a req-58d11754-e419-4dbf-92f4-c2b482a4be8b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-526de792-1f81-4aae-8864-943092e6218a req-58d11754-e419-4dbf-92f4-c2b482a4be8b service nova] Acquiring lock "e245a015-fc98-4557-8168-5089c3746e79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-526de792-1f81-4aae-8864-943092e6218a req-58d11754-e419-4dbf-92f4-c2b482a4be8b service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-526de792-1f81-4aae-8864-943092e6218a req-58d11754-e419-4dbf-92f4-c2b482a4be8b service nova] Lock "e245a015-fc98-4557-8168-5089c3746e79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-526de792-1f81-4aae-8864-943092e6218a req-58d11754-e419-4dbf-92f4-c2b482a4be8b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] No waiting events found dispatching network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:18:23 user nova-compute[74959]: WARNING nova.compute.manager [req-526de792-1f81-4aae-8864-943092e6218a req-58d11754-e419-4dbf-92f4-c2b482a4be8b service nova] [instance: e245a015-fc98-4557-8168-5089c3746e79] Received unexpected event network-vif-plugged-7515dc9f-ea5a-4b39-ae4a-25e4a304e2c0 for instance with vm_state deleted and task_state None.
Nov 28 23:18:23 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:18:23 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:18:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:23 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Deleted allocations for instance e245a015-fc98-4557-8168-5089c3746e79
Nov 28 23:18:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c310ea82-227f-42e4-8261-164350a0bf82 tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "e245a015-fc98-4557-8168-5089c3746e79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.706s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:18:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:18:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:18:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:18:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-c87c5497-48ca-41e2-a5c7-e7226cce3089 req-a01737f5-d8f8-45c1-b477-ecd4d368991d service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-changed-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:42 user nova-compute[74959]: DEBUG nova.compute.manager [req-c87c5497-48ca-41e2-a5c7-e7226cce3089 req-a01737f5-d8f8-45c1-b477-ecd4d368991d service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Refreshing instance network info cache due to event network-changed-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:18:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c87c5497-48ca-41e2-a5c7-e7226cce3089 req-a01737f5-d8f8-45c1-b477-ecd4d368991d service nova] Acquiring lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:18:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c87c5497-48ca-41e2-a5c7-e7226cce3089 req-a01737f5-d8f8-45c1-b477-ecd4d368991d service nova] Acquired lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:18:42 user nova-compute[74959]: DEBUG nova.network.neutron [req-c87c5497-48ca-41e2-a5c7-e7226cce3089 req-a01737f5-d8f8-45c1-b477-ecd4d368991d service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Refreshing network info cache for port bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:18:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:43 user nova-compute[74959]: INFO nova.compute.manager [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Detaching volume d9b38ce6-a03f-4522-9536-54cf8742e26c
Nov 28 23:18:43 user nova-compute[74959]: DEBUG nova.network.neutron [req-c87c5497-48ca-41e2-a5c7-e7226cce3089 req-a01737f5-d8f8-45c1-b477-ecd4d368991d service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updated VIF entry in instance network info cache for port bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:18:43 user nova-compute[74959]: DEBUG nova.network.neutron [req-c87c5497-48ca-41e2-a5c7-e7226cce3089 req-a01737f5-d8f8-45c1-b477-ecd4d368991d service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c87c5497-48ca-41e2-a5c7-e7226cce3089 req-a01737f5-d8f8-45c1-b477-ecd4d368991d service nova] Releasing lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:18:43 user nova-compute[74959]: INFO nova.virt.block_device [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Attempting to driver detach volume d9b38ce6-a03f-4522-9536-54cf8742e26c from mountpoint /dev/vdb
Nov 28 23:18:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Attempting to detach device vdb from instance 4645bea5-5301-4394-9ad8-0bc352a99dda from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:18:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:18:43 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:18:43 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:18:43 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:18:43 user nova-compute[74959]:   <serial>d9b38ce6-a03f-4522-9536-54cf8742e26c</serial>
Nov 28 23:18:43 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:18:43 user nova-compute[74959]: </disk>
Nov 28 23:18:43 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:18:43 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Successfully detached device vdb from instance 4645bea5-5301-4394-9ad8-0bc352a99dda from the persistent domain config.
Nov 28 23:18:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4645bea5-5301-4394-9ad8-0bc352a99dda from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:18:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:18:43 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:18:43 user nova-compute[74959]:   <source dev="/dev/sde"/>
Nov 28 23:18:43 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:18:43 user nova-compute[74959]:   <serial>d9b38ce6-a03f-4522-9536-54cf8742e26c</serial>
Nov 28 23:18:43 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:18:43 user nova-compute[74959]: </disk>
Nov 28 23:18:43 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:18:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:18:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-d8db2fc2-c564-48e4-b0e6-bbd4e1785448 req-4dc0de6d-3815-4be4-93e9-8c3d422d0534 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-changed-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-d8db2fc2-c564-48e4-b0e6-bbd4e1785448 req-4dc0de6d-3815-4be4-93e9-8c3d422d0534 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Refreshing instance network info cache due to event network-changed-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:18:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8db2fc2-c564-48e4-b0e6-bbd4e1785448 req-4dc0de6d-3815-4be4-93e9-8c3d422d0534 service nova] Acquiring lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:18:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8db2fc2-c564-48e4-b0e6-bbd4e1785448 req-4dc0de6d-3815-4be4-93e9-8c3d422d0534 service nova] Acquired lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:18:44 user nova-compute[74959]: DEBUG nova.network.neutron [req-d8db2fc2-c564-48e4-b0e6-bbd4e1785448 req-4dc0de6d-3815-4be4-93e9-8c3d422d0534 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Refreshing network info cache for port bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:18:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-d8db2fc2-c564-48e4-b0e6-bbd4e1785448 req-4dc0de6d-3815-4be4-93e9-8c3d422d0534 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updated VIF entry in instance network info cache for port bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:18:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-d8db2fc2-c564-48e4-b0e6-bbd4e1785448 req-4dc0de6d-3815-4be4-93e9-8c3d422d0534 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d8db2fc2-c564-48e4-b0e6-bbd4e1785448 req-4dc0de6d-3815-4be4-93e9-8c3d422d0534 service nova] Releasing lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:18:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:18:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "0992d274-8252-4601-8dc3-45e610eedc20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "0992d274-8252-4601-8dc3-45e610eedc20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "0992d274-8252-4601-8dc3-45e610eedc20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:51 user nova-compute[74959]: INFO nova.compute.manager [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Terminating instance
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-9e74a5ef-9631-45a9-b752-18285d595856 req-d0608739-6ad6-42b9-af75-85f9af47cea8 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received event network-vif-unplugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9e74a5ef-9631-45a9-b752-18285d595856 req-d0608739-6ad6-42b9-af75-85f9af47cea8 service nova] Acquiring lock "0992d274-8252-4601-8dc3-45e610eedc20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9e74a5ef-9631-45a9-b752-18285d595856 req-d0608739-6ad6-42b9-af75-85f9af47cea8 service nova] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9e74a5ef-9631-45a9-b752-18285d595856 req-d0608739-6ad6-42b9-af75-85f9af47cea8 service nova] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-9e74a5ef-9631-45a9-b752-18285d595856 req-d0608739-6ad6-42b9-af75-85f9af47cea8 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] No waiting events found dispatching network-vif-unplugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.compute.manager [req-9e74a5ef-9631-45a9-b752-18285d595856 req-d0608739-6ad6-42b9-af75-85f9af47cea8 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received event network-vif-unplugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Instance destroyed successfully.
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.objects.instance [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lazy-loading 'resources' on Instance uuid 0992d274-8252-4601-8dc3-45e610eedc20 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1891530339',display_name='tempest-VolumesActionsTest-instance-1891530339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1891530339',id=37,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='970869d439544caa9fbc57b53c962c23',ramdisk_id='',reservation_id='r-nh6ngdx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-209175437',owner_user_name='tempest-VolumesActionsTest-209175437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:17:07Z,user_data=None,user_id='22870bdb55a94a2c938fa2f4b663f09d',uuid=0992d274-8252-4601-8dc3-45e610eedc20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converting VIF {"id": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "address": "fa:16:3e:5c:f1:1e", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd096953d-ca", "ovs_interfaceid": "d096953d-ca4e-4b2c-87b8-dea60bdbeb12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=d096953d-ca4e-4b2c-87b8-dea60bdbeb12,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd096953d-ca') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG os_vif [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=d096953d-ca4e-4b2c-87b8-dea60bdbeb12,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd096953d-ca') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd096953d-ca, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d72e2aae-ffc8-46c0-bc2a-afcc9f14b179) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:51 user nova-compute[74959]: INFO os_vif [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=d096953d-ca4e-4b2c-87b8-dea60bdbeb12,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd096953d-ca')
Nov 28 23:18:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Deleting instance files /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20_del
Nov 28 23:18:51 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Deletion of /opt/stack/data/nova/instances/0992d274-8252-4601-8dc3-45e610eedc20_del complete
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:18:51 user nova-compute[74959]: INFO nova.compute.manager [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 28 23:18:51 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:18:51 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:52 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Took 0.46 seconds to deallocate network for instance.
Nov 28 23:18:52 user nova-compute[74959]: DEBUG nova.compute.manager [req-cac4ca35-d76d-4d7a-9397-6cb42834999d req-3f79bd4c-b68b-4b2d-bad0-c5dbc4ccea4f service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received event network-vif-deleted-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [{"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-4645bea5-5301-4394-9ad8-0bc352a99dda" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:18:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:52 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Deleted allocations for instance 0992d274-8252-4601-8dc3-45e610eedc20
Nov 28 23:18:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-84d2c0eb-6059-4148-b7a5-bc1dca3d45a9 tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "0992d274-8252-4601-8dc3-45e610eedc20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-98914f2d-aa7e-4bce-b019-ff2ea4e518dd req-26d3219f-14d3-4e05-9c8e-850080eb4bf1 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received event network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-98914f2d-aa7e-4bce-b019-ff2ea4e518dd req-26d3219f-14d3-4e05-9c8e-850080eb4bf1 service nova] Acquiring lock "0992d274-8252-4601-8dc3-45e610eedc20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-98914f2d-aa7e-4bce-b019-ff2ea4e518dd req-26d3219f-14d3-4e05-9c8e-850080eb4bf1 service nova] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-98914f2d-aa7e-4bce-b019-ff2ea4e518dd req-26d3219f-14d3-4e05-9c8e-850080eb4bf1 service nova] Lock "0992d274-8252-4601-8dc3-45e610eedc20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-98914f2d-aa7e-4bce-b019-ff2ea4e518dd req-26d3219f-14d3-4e05-9c8e-850080eb4bf1 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] No waiting events found dispatching network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:18:53 user nova-compute[74959]: WARNING nova.compute.manager [req-98914f2d-aa7e-4bce-b019-ff2ea4e518dd req-26d3219f-14d3-4e05-9c8e-850080eb4bf1 service nova] [instance: 0992d274-8252-4601-8dc3-45e610eedc20] Received unexpected event network-vif-plugged-d096953d-ca4e-4b2c-87b8-dea60bdbeb12 for instance with vm_state deleted and task_state None.
Nov 28 23:18:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:18:53 user nova-compute[74959]: INFO nova.compute.claims [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Claim successful on node user
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:18:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.policy [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18a99b86ac9844fd8ad2329e41d22c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e44315cc7e42f3ac72740bfba170e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:18:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Creating image(s)
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "/opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "/opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk 1073741824" returned: 0 in 0.060s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Successfully created port: 6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.195s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Cannot resize image /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Ensure instance console log exists: /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:18:55 user nova-compute[74959]: INFO nova.compute.claims [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Claim successful on node user
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Successfully updated port: 6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquired lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-c6acf1c1-a8a7-4f19-bd3f-778e5db99672 req-23fc952d-8840-4a4d-916d-2259b8da6045 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received event network-changed-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-c6acf1c1-a8a7-4f19-bd3f-778e5db99672 req-23fc952d-8840-4a4d-916d-2259b8da6045 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Refreshing instance network info cache due to event network-changed-6d5f273c-1220-4e91-9659-59b5178d669a. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c6acf1c1-a8a7-4f19-bd3f-778e5db99672 req-23fc952d-8840-4a4d-916d-2259b8da6045 service nova] Acquiring lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.267s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:18:55 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:18:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:18:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.policy [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73af90e11a374c9cbf0a58db8410e245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac0d1f399f040f98098e84ac875c1fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:18:56 user nova-compute[74959]: INFO nova.virt.block_device [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Booting with volume d26f5e53-5dd4-4660-94a5-5887fc2f85db at /dev/vda
Nov 28 23:18:56 user nova-compute[74959]: DEBUG os_brick.utils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Updating instance_info_cache with network_info: [{"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bbf5b6-ae79-4838-b4f1-e24a92e2350d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Releasing lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Instance network_info: |[{"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c6acf1c1-a8a7-4f19-bd3f-778e5db99672 req-23fc952d-8840-4a4d-916d-2259b8da6045 service nova] Acquired lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.neutron [req-c6acf1c1-a8a7-4f19-bd3f-778e5db99672 req-23fc952d-8840-4a4d-916d-2259b8da6045 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Refreshing network info cache for port 6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Start _get_guest_xml network_info=[{"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c12c6c-88cf-49d8-bc1c-535291aaa661]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c554bca1-4ebb-4e24-af16-8663bd3205c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[979142b7-122d-45fd-8758-82e40ff8f3e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:18:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:18:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2030406951',display_name='tempest-VolumesSnapshotTestJSON-instance-2030406951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2030406951',id=39,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrglRm+FKzUxkzaSf480FPz4SnvvElDuG2L2kF3HbsVXESBainN+4Q4gBPzfBpHv9r36TeovWSz4kLGWKBE73oJd+oRQMH0R98s2UW40uLuKJfnjUKXIwerb84qBgDXLw==',key_name='tempest-keypair-1170964908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4e44315cc7e42f3ac72740bfba170e4',ramdisk_id='',reservation_id='r-ix6tm5p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1119708422',owner_user_name='tempest-VolumesSnapshotTestJSON-1119708422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:18:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18a99b86ac9844fd8ad2329e41d22c65',uuid=7bce9741-61f6-4141-be40-e779d536fa0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converting VIF {"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=6d5f273c-1220-4e91-9659-59b5178d669a,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5f273c-12') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bce9741-61f6-4141-be40-e779d536fa0a {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:18:56 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fedd267-82cf-4815-8c68-1eb99ecde2f1]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG os_brick.utils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating existing volume attachment record: 6b5686e9-673e-4c9a-942b-8a0ed9ca82fe {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:18:56 user nova-compute[74959]:   <uuid>7bce9741-61f6-4141-be40-e779d536fa0a</uuid>
Nov 28 23:18:56 user nova-compute[74959]:   <name>instance-00000027</name>
Nov 28 23:18:56 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:18:56 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:18:56 user nova-compute[74959]:   <metadata>
Nov 28 23:18:56 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:18:56 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:18:56 user nova-compute[74959]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2030406951</nova:name>
Nov 28 23:18:56 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:18:56</nova:creationTime>
Nov 28 23:18:56 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:18:56 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:18:56 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:18:56 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:18:56 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:18:56 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:18:56 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:18:56 user nova-compute[74959]:       <nova:owner>
Nov 28 23:18:56 user nova-compute[74959]:         <nova:user uuid="18a99b86ac9844fd8ad2329e41d22c65">tempest-VolumesSnapshotTestJSON-1119708422-project-member</nova:user>
Nov 28 23:18:56 user nova-compute[74959]:         <nova:project uuid="b4e44315cc7e42f3ac72740bfba170e4">tempest-VolumesSnapshotTestJSON-1119708422</nova:project>
Nov 28 23:18:56 user nova-compute[74959]:       </nova:owner>
Nov 28 23:18:56 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:18:56 user nova-compute[74959]:       <nova:ports>
Nov 28 23:18:56 user nova-compute[74959]:         <nova:port uuid="6d5f273c-1220-4e91-9659-59b5178d669a">
Nov 28 23:18:56 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:18:56 user nova-compute[74959]:         </nova:port>
Nov 28 23:18:56 user nova-compute[74959]:       </nova:ports>
Nov 28 23:18:56 user nova-compute[74959]:     </nova:instance>
Nov 28 23:18:56 user nova-compute[74959]:   </metadata>
Nov 28 23:18:56 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:18:56 user nova-compute[74959]:     <system>
Nov 28 23:18:56 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:18:56 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:18:56 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:18:56 user nova-compute[74959]:       <entry name="serial">7bce9741-61f6-4141-be40-e779d536fa0a</entry>
Nov 28 23:18:56 user nova-compute[74959]:       <entry name="uuid">7bce9741-61f6-4141-be40-e779d536fa0a</entry>
Nov 28 23:18:56 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:18:56 user nova-compute[74959]:     </system>
Nov 28 23:18:56 user nova-compute[74959]:   </sysinfo>
Nov 28 23:18:56 user nova-compute[74959]:   <os>
Nov 28 23:18:56 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:18:56 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:18:56 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:18:56 user nova-compute[74959]:   </os>
Nov 28 23:18:56 user nova-compute[74959]:   <features>
Nov 28 23:18:56 user nova-compute[74959]:     <acpi/>
Nov 28 23:18:56 user nova-compute[74959]:     <apic/>
Nov 28 23:18:56 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:18:56 user nova-compute[74959]:   </features>
Nov 28 23:18:56 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:18:56 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:18:56 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:18:56 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:18:56 user nova-compute[74959]:   </clock>
Nov 28 23:18:56 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:18:56 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:18:56 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:18:56 user nova-compute[74959]:   </cpu>
Nov 28 23:18:56 user nova-compute[74959]:   <devices>
Nov 28 23:18:56 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:18:56 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:18:56 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk"/>
Nov 28 23:18:56 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:18:56 user nova-compute[74959]:     </disk>
Nov 28 23:18:56 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:18:56 user nova-compute[74959]:       <mac address="fa:16:3e:7f:fc:c7"/>
Nov 28 23:18:56 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:18:56 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:18:56 user nova-compute[74959]:       <target dev="tap6d5f273c-12"/>
Nov 28 23:18:56 user nova-compute[74959]:     </interface>
Nov 28 23:18:56 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:18:56 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/console.log" append="off"/>
Nov 28 23:18:56 user nova-compute[74959]:     </serial>
Nov 28 23:18:56 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:18:56 user nova-compute[74959]:     <video>
Nov 28 23:18:56 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:18:56 user nova-compute[74959]:     </video>
Nov 28 23:18:56 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:18:56 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:18:56 user nova-compute[74959]:     </rng>
Nov 28 23:18:56 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:18:56 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:18:56 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:18:56 user nova-compute[74959]:     </memballoon>
Nov 28 23:18:56 user nova-compute[74959]:   </devices>
Nov 28 23:18:56 user nova-compute[74959]: </domain>
Nov 28 23:18:56 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2030406951',display_name='tempest-VolumesSnapshotTestJSON-instance-2030406951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2030406951',id=39,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrglRm+FKzUxkzaSf480FPz4SnvvElDuG2L2kF3HbsVXESBainN+4Q4gBPzfBpHv9r36TeovWSz4kLGWKBE73oJd+oRQMH0R98s2UW40uLuKJfnjUKXIwerb84qBgDXLw==',key_name='tempest-keypair-1170964908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4e44315cc7e42f3ac72740bfba170e4',ramdisk_id='',reservation_id='r-ix6tm5p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1119708422',owner_user_name='tempest-VolumesSnapshotTestJSON-1119708422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:18:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18a99b86ac9844fd8ad2329e41d22c65',uuid=7bce9741-61f6-4141-be40-e779d536fa0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converting VIF {"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=6d5f273c-1220-4e91-9659-59b5178d669a,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5f273c-12') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG os_vif [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=6d5f273c-1220-4e91-9659-59b5178d669a,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5f273c-12') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '886d9c2a-b8ea-5886-bbe9-23103993e56e', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d5f273c-12, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d5f273c-12, col_values=(('qos', UUID('9c7d82e0-04ca-47ec-98cd-bac82f59a6e0')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d5f273c-12, col_values=(('external_ids', {'iface-id': '6d5f273c-1220-4e91-9659-59b5178d669a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:fc:c7', 'vm-uuid': '7bce9741-61f6-4141-be40-e779d536fa0a'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:56 user nova-compute[74959]: INFO os_vif [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=6d5f273c-1220-4e91-9659-59b5178d669a,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5f273c-12')
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No VIF found with MAC fa:16:3e:7f:fc:c7, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Successfully created port: b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.neutron [req-c6acf1c1-a8a7-4f19-bd3f-778e5db99672 req-23fc952d-8840-4a4d-916d-2259b8da6045 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Updated VIF entry in instance network info cache for port 6d5f273c-1220-4e91-9659-59b5178d669a. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG nova.network.neutron [req-c6acf1c1-a8a7-4f19-bd3f-778e5db99672 req-23fc952d-8840-4a4d-916d-2259b8da6045 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Updating instance_info_cache with network_info: [{"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c6acf1c1-a8a7-4f19-bd3f-778e5db99672 req-23fc952d-8840-4a4d-916d-2259b8da6045 service nova] Releasing lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Successfully updated port: b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquired lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-0d1fc949-0622-4bd2-ade5-163844be7848 req-f79da880-f7e4-4333-a53a-0f9284ae78e4 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-changed-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.compute.manager [req-0d1fc949-0622-4bd2-ade5-163844be7848 req-f79da880-f7e4-4333-a53a-0f9284ae78e4 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Refreshing instance network info cache due to event network-changed-b3bc71e3-1363-4d17-bb0a-89df3579237f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0d1fc949-0622-4bd2-ade5-163844be7848 req-f79da880-f7e4-4333-a53a-0f9284ae78e4 service nova] Acquiring lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating instance_info_cache with network_info: [{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Releasing lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance network_info: |[{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0d1fc949-0622-4bd2-ade5-163844be7848 req-f79da880-f7e4-4333-a53a-0f9284ae78e4 service nova] Acquired lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG nova.network.neutron [req-0d1fc949-0622-4bd2-ade5-163844be7848 req-f79da880-f7e4-4333-a53a-0f9284ae78e4 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Refreshing network info cache for port b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-0d1fc949-0622-4bd2-ade5-163844be7848 req-f79da880-f7e4-4333-a53a-0f9284ae78e4 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updated VIF entry in instance network info cache for port b3bc71e3-1363-4d17-bb0a-89df3579237f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG nova.network.neutron [req-0d1fc949-0622-4bd2-ade5-163844be7848 req-f79da880-f7e4-4333-a53a-0f9284ae78e4 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating instance_info_cache with network_info: [{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0d1fc949-0622-4bd2-ade5-163844be7848 req-f79da880-f7e4-4333-a53a-0f9284ae78e4 service nova] Releasing lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:18:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:18:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received event network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] No waiting events found dispatching network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:00 user nova-compute[74959]: WARNING nova.compute.manager [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received unexpected event network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a for instance with vm_state building and task_state spawning.
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received event network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] No waiting events found dispatching network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:00 user nova-compute[74959]: WARNING nova.compute.manager [req-87b2559e-2827-4a6c-9729-3b9f412b7b15 req-808916c0-2c08-4ac3-963a-501b14e82396 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received unexpected event network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a for instance with vm_state building and task_state spawning.
Nov 28 23:19:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:19:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8026MB free_disk=24.95306396484375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Instance spawned successfully.
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:00 user nova-compute[74959]: INFO nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 4645bea5-5301-4394-9ad8-0bc352a99dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 2704bdaf-e70f-469e-9e88-b711b229dd6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 15eae952-f2b9-4762-8daf-ef551b24931d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7bce9741-61f6-4141-be40-e779d536fa0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:19:00 user nova-compute[74959]: INFO nova.compute.manager [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Took 6.52 seconds to build instance.
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ba4b7f83-cf98-432f-8463-e27f6878d68b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.690s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:19:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:19:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:19:03 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Creating image(s)
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Ensure instance console log exists: /opt/stack/data/nova/instances/6533acac-8b30-4eb5-ba8f-16560e1d5af7/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Start _get_guest_xml network_info=[{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKcEqOsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6533acac-8b30-4eb5-ba8f-16560e1d5af7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd26f5e53-5dd4-4660-94a5-5887fc2f85db', 'serial': 'd26f5e53-5dd4-4660-94a5-5887fc2f85db'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '6b5686e9-673e-4c9a-942b-8a0ed9ca82fe', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:19:03 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4645bea5-5301-4394-9ad8-0bc352a99dda is timed out.
Nov 28 23:19:03 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Successfully detached device vdb from instance 4645bea5-5301-4394-9ad8-0bc352a99dda from the live domain config.
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzkcxSwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:19:03 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:19:03 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:19:03 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKcEqOsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:19:03 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ccadc0-b525-4012-9960-c62c4176d450]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:19:03 user nova-compute[74959]: No targets found.
Nov 28 23:19:03 user nova-compute[74959]: iSNS:
Nov 28 23:19:03 user nova-compute[74959]: No targets found.
Nov 28 23:19:03 user nova-compute[74959]: STATIC:
Nov 28 23:19:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7
Nov 28 23:19:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:19:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:19:03 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c
Nov 28 23:19:03 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:19:03 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:19:03 user nova-compute[74959]: FIRMWARE:
Nov 28 23:19:03 user nova-compute[74959]: No targets found.
Nov 28 23:19:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:19:03 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:19:03 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ee0eff-5c92-47dc-b53f-e66c0df00c9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc9220d-163a-4a4a-949f-8bac798b10ec]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:19:03 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c (non-flash)
Nov 28 23:19:03 user nova-compute[74959]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef47a6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c'): ({'sde'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Removing single pathed devices sde {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[67225f71-6261-4207-abbb-c6670cd5be59]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c06a1e-16f8-4d10-aadb-d625fe652105]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Flushing IO for device /dev/sde {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e019650a-0fce-4edd-b41a-b30999db1181]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3314dab-b49a-4675-a474-b959630ac826]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] SCSI volumes sde have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef4c0a2-d123-49fb-b427-66669e484e40]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5841ac-5629-47db-b8de-b6d25fe6103c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c, portal: 172.16.0.220,3260]
Nov 28 23:19:03 user nova-compute[74959]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c, portal: 172.16.0.220,3260] successful.
Nov 28 23:19:03 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9b38ce6-a03f-4522-9536-54cf8742e26c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9881378-d9d3-4620-a20e-66c96f2393b1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] <== disconnect_volume: return (335ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.300s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:19:04 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:19:04 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e71aa8-e8c6-4a5a-a067-7b8aad175316]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:19:04 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f3a9b-45de-4bc0-9a29-e40d98ad5ae0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db] added
Nov 28 23:19:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[35247083-711b-4f76-b5f3-e49824c08ace]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c305f7-91a2-4a25-ba17-cabee3517620]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKcEqOsN {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKcEqOsN" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96b003b-34b4-4a09-ae3b-7412117188aa]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKcEqOsN'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b856a1-2ca8-46bd-a8cb-3bace6b36563]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1c0302-5bce-4e0a-931e-817867733f8f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9991fa-d08e-41f8-ac66-9e72115d6352]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260]
Nov 28 23:19:04 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260] successful.
Nov 28 23:19:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7975431-de45-4a1a-8827-68802e69dc89]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[12688606-5790-41e4-9736-a3e91f95e804]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:04 user nova-compute[74959]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:19:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:04 user nova-compute[74959]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:19:04 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33c0536-9104-43ed-9d2b-f8e8a2dfe9de]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKcEqOsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'flavor' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:19:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fb44963e-1f86-45b9-bed5-7a34c9e4b37f tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.825s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== connect_volume: return (1625ms) {'type': 'block', 'scsi_wwn': '23931653334393531', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653334393531', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1289172084',display_name='tempest-ServerActionsTestOtherA-server-1289172084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1289172084',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-s1z8orwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6533acac-8b30-4eb5-ba8f-16560e1d5af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'pci_devices' on Instance uuid 6533acac-8b30-4eb5-ba8f-16560e1d5af7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:19:05 user nova-compute[74959]:   <uuid>6533acac-8b30-4eb5-ba8f-16560e1d5af7</uuid>
Nov 28 23:19:05 user nova-compute[74959]:   <name>instance-00000028</name>
Nov 28 23:19:05 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:19:05 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:19:05 user nova-compute[74959]:   <metadata>
Nov 28 23:19:05 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:19:05 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:19:05 user nova-compute[74959]:       <nova:name>tempest-ServerActionsTestOtherA-server-1289172084</nova:name>
Nov 28 23:19:05 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:19:03</nova:creationTime>
Nov 28 23:19:05 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:19:05 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:19:05 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:19:05 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:19:05 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:19:05 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:19:05 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:19:05 user nova-compute[74959]:       <nova:owner>
Nov 28 23:19:05 user nova-compute[74959]:         <nova:user uuid="73af90e11a374c9cbf0a58db8410e245">tempest-ServerActionsTestOtherA-2143945835-project-member</nova:user>
Nov 28 23:19:05 user nova-compute[74959]:         <nova:project uuid="0ac0d1f399f040f98098e84ac875c1fd">tempest-ServerActionsTestOtherA-2143945835</nova:project>
Nov 28 23:19:05 user nova-compute[74959]:       </nova:owner>
Nov 28 23:19:05 user nova-compute[74959]:       <nova:ports>
Nov 28 23:19:05 user nova-compute[74959]:         <nova:port uuid="b3bc71e3-1363-4d17-bb0a-89df3579237f">
Nov 28 23:19:05 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 23:19:05 user nova-compute[74959]:         </nova:port>
Nov 28 23:19:05 user nova-compute[74959]:       </nova:ports>
Nov 28 23:19:05 user nova-compute[74959]:     </nova:instance>
Nov 28 23:19:05 user nova-compute[74959]:   </metadata>
Nov 28 23:19:05 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:19:05 user nova-compute[74959]:     <system>
Nov 28 23:19:05 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:19:05 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:19:05 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:19:05 user nova-compute[74959]:       <entry name="serial">6533acac-8b30-4eb5-ba8f-16560e1d5af7</entry>
Nov 28 23:19:05 user nova-compute[74959]:       <entry name="uuid">6533acac-8b30-4eb5-ba8f-16560e1d5af7</entry>
Nov 28 23:19:05 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:19:05 user nova-compute[74959]:     </system>
Nov 28 23:19:05 user nova-compute[74959]:   </sysinfo>
Nov 28 23:19:05 user nova-compute[74959]:   <os>
Nov 28 23:19:05 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:19:05 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:19:05 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:19:05 user nova-compute[74959]:   </os>
Nov 28 23:19:05 user nova-compute[74959]:   <features>
Nov 28 23:19:05 user nova-compute[74959]:     <acpi/>
Nov 28 23:19:05 user nova-compute[74959]:     <apic/>
Nov 28 23:19:05 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:19:05 user nova-compute[74959]:   </features>
Nov 28 23:19:05 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:19:05 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:19:05 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:19:05 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:19:05 user nova-compute[74959]:   </clock>
Nov 28 23:19:05 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:19:05 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:19:05 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:19:05 user nova-compute[74959]:   </cpu>
Nov 28 23:19:05 user nova-compute[74959]:   <devices>
Nov 28 23:19:05 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:19:05 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:19:05 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:19:05 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:19:05 user nova-compute[74959]:       <serial>d26f5e53-5dd4-4660-94a5-5887fc2f85db</serial>
Nov 28 23:19:05 user nova-compute[74959]:     </disk>
Nov 28 23:19:05 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:19:05 user nova-compute[74959]:       <mac address="fa:16:3e:b9:d3:c0"/>
Nov 28 23:19:05 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:19:05 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:19:05 user nova-compute[74959]:       <target dev="tapb3bc71e3-13"/>
Nov 28 23:19:05 user nova-compute[74959]:     </interface>
Nov 28 23:19:05 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:19:05 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/6533acac-8b30-4eb5-ba8f-16560e1d5af7/console.log" append="off"/>
Nov 28 23:19:05 user nova-compute[74959]:     </serial>
Nov 28 23:19:05 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:19:05 user nova-compute[74959]:     <video>
Nov 28 23:19:05 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:19:05 user nova-compute[74959]:     </video>
Nov 28 23:19:05 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:19:05 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:19:05 user nova-compute[74959]:     </rng>
Nov 28 23:19:05 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:19:05 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:19:05 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:19:05 user nova-compute[74959]:     </memballoon>
Nov 28 23:19:05 user nova-compute[74959]:   </devices>
Nov 28 23:19:05 user nova-compute[74959]: </domain>
Nov 28 23:19:05 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1289172084',display_name='tempest-ServerActionsTestOtherA-server-1289172084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1289172084',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-s1z8orwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6533acac-8b30-4eb5-ba8f-16560e1d5af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG os_vif [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba170e8e-377b-5d6b-a799-43537bf92577', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3bc71e3-13, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3bc71e3-13, col_values=(('qos', UUID('747ba156-1829-4717-9463-5df9350324ae')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3bc71e3-13, col_values=(('external_ids', {'iface-id': 'b3bc71e3-1363-4d17-bb0a-89df3579237f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:d3:c0', 'vm-uuid': '6533acac-8b30-4eb5-ba8f-16560e1d5af7'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:05 user nova-compute[74959]: INFO os_vif [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13')
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:19:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No VIF found with MAC fa:16:3e:b9:d3:c0, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:19:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-c19ea948-7720-4a9c-8aba-035c5390974f req-92c71f2a-0e28-4a80-9ccb-4d0597588622 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c19ea948-7720-4a9c-8aba-035c5390974f req-92c71f2a-0e28-4a80-9ccb-4d0597588622 service nova] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c19ea948-7720-4a9c-8aba-035c5390974f req-92c71f2a-0e28-4a80-9ccb-4d0597588622 service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c19ea948-7720-4a9c-8aba-035c5390974f req-92c71f2a-0e28-4a80-9ccb-4d0597588622 service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-c19ea948-7720-4a9c-8aba-035c5390974f req-92c71f2a-0e28-4a80-9ccb-4d0597588622 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] No waiting events found dispatching network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:06 user nova-compute[74959]: WARNING nova.compute.manager [req-c19ea948-7720-4a9c-8aba-035c5390974f req-92c71f2a-0e28-4a80-9ccb-4d0597588622 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received unexpected event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f for instance with vm_state building and task_state spawning.
Nov 28 23:19:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:19:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance spawned successfully.
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:08 user nova-compute[74959]: INFO nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-d6d2757c-386d-4975-bb94-a892b4d50e0b req-c1c3cdcb-4cb2-41da-9ffb-dc3b75b3325a service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d6d2757c-386d-4975-bb94-a892b4d50e0b req-c1c3cdcb-4cb2-41da-9ffb-dc3b75b3325a service nova] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d6d2757c-386d-4975-bb94-a892b4d50e0b req-c1c3cdcb-4cb2-41da-9ffb-dc3b75b3325a service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d6d2757c-386d-4975-bb94-a892b4d50e0b req-c1c3cdcb-4cb2-41da-9ffb-dc3b75b3325a service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-d6d2757c-386d-4975-bb94-a892b4d50e0b req-c1c3cdcb-4cb2-41da-9ffb-dc3b75b3325a service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] No waiting events found dispatching network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:08 user nova-compute[74959]: WARNING nova.compute.manager [req-d6d2757c-386d-4975-bb94-a892b4d50e0b req-c1c3cdcb-4cb2-41da-9ffb-dc3b75b3325a service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received unexpected event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f for instance with vm_state building and task_state spawning.
Nov 28 23:19:08 user nova-compute[74959]: INFO nova.compute.manager [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Took 13.70 seconds to build instance.
Nov 28 23:19:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d58a93f1-316d-4d1a-982f-0c3604c76340 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.801s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:11 user nova-compute[74959]: INFO nova.compute.manager [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Terminating instance
Nov 28 23:19:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c12e1e2-1215-4118-9368-3842c8e333db req-b89a086b-a4b0-4926-9f37-cd3a1509605d service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received event network-vif-unplugged-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c12e1e2-1215-4118-9368-3842c8e333db req-b89a086b-a4b0-4926-9f37-cd3a1509605d service nova] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c12e1e2-1215-4118-9368-3842c8e333db req-b89a086b-a4b0-4926-9f37-cd3a1509605d service nova] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c12e1e2-1215-4118-9368-3842c8e333db req-b89a086b-a4b0-4926-9f37-cd3a1509605d service nova] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c12e1e2-1215-4118-9368-3842c8e333db req-b89a086b-a4b0-4926-9f37-cd3a1509605d service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] No waiting events found dispatching network-vif-unplugged-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c12e1e2-1215-4118-9368-3842c8e333db req-b89a086b-a4b0-4926-9f37-cd3a1509605d service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received event network-vif-unplugged-c002f120-e445-4832-b505-e442b42a7dce for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:19:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Instance destroyed successfully.
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.objects.instance [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lazy-loading 'resources' on Instance uuid 598c6a68-9826-4fc1-a6ee-17eafd5b14e8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T22:58:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1138376429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1138376429',id=1,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T22:58:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8da22f0050e34c9b9a7658f16c08f28b',ramdisk_id='',reservation_id='r-gmhous2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:00:39Z,user_data=None,user_id='5a8d218abbe14f27b754f1fffd9553f8',uuid=598c6a68-9826-4fc1-a6ee-17eafd5b14e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converting VIF {"id": "c002f120-e445-4832-b505-e442b42a7dce", "address": "fa:16:3e:c7:d4:6d", "network": {"id": "8a1f1b2f-7a05-4996-aacc-5709a211ad88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-413466298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8da22f0050e34c9b9a7658f16c08f28b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc002f120-e4", "ovs_interfaceid": "c002f120-e445-4832-b505-e442b42a7dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:d4:6d,bridge_name='br-int',has_traffic_filtering=True,id=c002f120-e445-4832-b505-e442b42a7dce,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc002f120-e4') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG os_vif [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:d4:6d,bridge_name='br-int',has_traffic_filtering=True,id=c002f120-e445-4832-b505-e442b42a7dce,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc002f120-e4') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc002f120-e4, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4fbda99-f13e-4dcd-a6fb-3515fee6e41d) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:19:12 user nova-compute[74959]: INFO os_vif [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:d4:6d,bridge_name='br-int',has_traffic_filtering=True,id=c002f120-e445-4832-b505-e442b42a7dce,network=Network(8a1f1b2f-7a05-4996-aacc-5709a211ad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc002f120-e4')
Nov 28 23:19:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Deleting instance files /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8_del
Nov 28 23:19:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Deletion of /opt/stack/data/nova/instances/598c6a68-9826-4fc1-a6ee-17eafd5b14e8_del complete
Nov 28 23:19:12 user nova-compute[74959]: INFO nova.compute.manager [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 23:19:12 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:19:12 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:19:13 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:19:13 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Took 0.56 seconds to deallocate network for instance.
Nov 28 23:19:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-b12419a5-37b0-4c39-b90b-fae7dbc0aa85 req-bcf918e7-701a-4b95-be0e-61dd44fe52e4 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received event network-vif-deleted-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:13 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:19:13 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:19:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:13 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Deleted allocations for instance 598c6a68-9826-4fc1-a6ee-17eafd5b14e8
Nov 28 23:19:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-264e6909-ceda-4050-80e3-3833eb508b8c tempest-ServerBootFromVolumeStableRescueTest-1156029205 tempest-ServerBootFromVolumeStableRescueTest-1156029205-project-member] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-28b02ddb-f7f3-49c4-b357-8037b8ed724b req-dca50f85-d014-4cf0-9edb-282930ed4e88 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received event network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28b02ddb-f7f3-49c4-b357-8037b8ed724b req-dca50f85-d014-4cf0-9edb-282930ed4e88 service nova] Acquiring lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28b02ddb-f7f3-49c4-b357-8037b8ed724b req-dca50f85-d014-4cf0-9edb-282930ed4e88 service nova] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28b02ddb-f7f3-49c4-b357-8037b8ed724b req-dca50f85-d014-4cf0-9edb-282930ed4e88 service nova] Lock "598c6a68-9826-4fc1-a6ee-17eafd5b14e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-28b02ddb-f7f3-49c4-b357-8037b8ed724b req-dca50f85-d014-4cf0-9edb-282930ed4e88 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] No waiting events found dispatching network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:14 user nova-compute[74959]: WARNING nova.compute.manager [req-28b02ddb-f7f3-49c4-b357-8037b8ed724b req-dca50f85-d014-4cf0-9edb-282930ed4e88 service nova] [instance: 598c6a68-9826-4fc1-a6ee-17eafd5b14e8] Received unexpected event network-vif-plugged-c002f120-e445-4832-b505-e442b42a7dce for instance with vm_state deleted and task_state None.
Nov 28 23:19:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-2e1e5e9b-7868-4ede-8a27-25fee8b32002 req-8a8e7192-1e58-4b86-8ed9-e56bae2edfaa service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received event network-changed-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-2e1e5e9b-7868-4ede-8a27-25fee8b32002 req-8a8e7192-1e58-4b86-8ed9-e56bae2edfaa service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Refreshing instance network info cache due to event network-changed-258fccdb-aa83-445c-ac76-c10826ff3fa9. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:19:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e1e5e9b-7868-4ede-8a27-25fee8b32002 req-8a8e7192-1e58-4b86-8ed9-e56bae2edfaa service nova] Acquiring lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:19:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e1e5e9b-7868-4ede-8a27-25fee8b32002 req-8a8e7192-1e58-4b86-8ed9-e56bae2edfaa service nova] Acquired lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:19:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-2e1e5e9b-7868-4ede-8a27-25fee8b32002 req-8a8e7192-1e58-4b86-8ed9-e56bae2edfaa service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Refreshing network info cache for port 258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:19:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-2e1e5e9b-7868-4ede-8a27-25fee8b32002 req-8a8e7192-1e58-4b86-8ed9-e56bae2edfaa service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updated VIF entry in instance network info cache for port 258fccdb-aa83-445c-ac76-c10826ff3fa9. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:19:16 user nova-compute[74959]: DEBUG nova.network.neutron [req-2e1e5e9b-7868-4ede-8a27-25fee8b32002 req-8a8e7192-1e58-4b86-8ed9-e56bae2edfaa service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating instance_info_cache with network_info: [{"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:19:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e1e5e9b-7868-4ede-8a27-25fee8b32002 req-8a8e7192-1e58-4b86-8ed9-e56bae2edfaa service nova] Releasing lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:19:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG nova.objects.instance [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:19 user nova-compute[74959]: INFO nova.compute.manager [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attaching volume 2f456504-3aa8-489c-9686-e2602fcae271 to /dev/vdb
Nov 28 23:19:19 user nova-compute[74959]: DEBUG os_brick.utils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e3fccc-615e-4e7e-898c-3617045ec97a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5f8608-c21c-4326-8ca6-9bfc28109001]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5e4602-6727-4bc8-be1f-9db2e7560ca0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d013d17-2896-4ddf-bde4-6fdc98581b32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:19:19 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:19:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65dbc24-4eeb-42c1-adb5-0275ac0b200c]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG os_brick.utils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:19:19 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating existing volume attachment record: 2881db66-6c3d-4b5c-89d7-01af5c8935e3 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:19:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWFnBRHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:19:27 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:19:27 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:19:27 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c031ddd3-c1f4-4b5b-9f52-95f3eb655b27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:19:27 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e9422-20bc-4d3c-8d51-78e960b6d54e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271] added
Nov 28 23:19:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.103s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[84377015-e8ae-49cb-93ed-e10b5f07b4d3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b3313e-ea6a-48bb-adc4-4105b284c71c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jWFnBRHK {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jWFnBRHK" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42cddb7-d792-48ab-9d09-65877732dbf4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jWFnBRHK'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[638562d4-09d5-4467-a4aa-2a219418728a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8f4912-29c2-4aff-bc74-150be9d043c7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:27 user nova-compute[74959]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:19:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:27 user nova-compute[74959]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:19:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9bac36-0682-449b-b39e-1530bcd157a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271, portal: 172.16.0.220,3260]
Nov 28 23:19:27 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271, portal: 172.16.0.220,3260] successful.
Nov 28 23:19:27 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbadc82-ed39-4096-81f3-2f68ee7822e6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:19:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b64ff-7a0a-4f0c-a0e6-fea72db3226b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:28 user nova-compute[74959]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:19:28 user nova-compute[74959]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)
Nov 28 23:19:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:19:28 user nova-compute[74959]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:19:28 user nova-compute[74959]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)
Nov 28 23:19:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b9c8d-858f-4a4f-a80f-2a875cac5983]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWFnBRHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26363393364653131', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363393364653131', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG nova.objects.instance [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:19:29 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:19:29 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:19:29 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:19:29 user nova-compute[74959]:   <serial>2f456504-3aa8-489c-9686-e2602fcae271</serial>
Nov 28 23:19:29 user nova-compute[74959]: </disk>
Nov 28 23:19:29 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No VIF found with MAC fa:16:3e:49:71:8b, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:19:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-95eb8175-d5c5-4dfb-b6e6-d5a72e0c0a50 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.865s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:33 user nova-compute[74959]: INFO nova.compute.manager [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Terminating instance
Nov 28 23:19:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-0139bda5-1407-4bbb-ba43-913f13e8282e req-58dd72ba-3d0d-4ecd-9fc3-a7afd5840b9d service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0139bda5-1407-4bbb-ba43-913f13e8282e req-58dd72ba-3d0d-4ecd-9fc3-a7afd5840b9d service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0139bda5-1407-4bbb-ba43-913f13e8282e req-58dd72ba-3d0d-4ecd-9fc3-a7afd5840b9d service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0139bda5-1407-4bbb-ba43-913f13e8282e req-58dd72ba-3d0d-4ecd-9fc3-a7afd5840b9d service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-0139bda5-1407-4bbb-ba43-913f13e8282e req-58dd72ba-3d0d-4ecd-9fc3-a7afd5840b9d service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-0139bda5-1407-4bbb-ba43-913f13e8282e req-58dd72ba-3d0d-4ecd-9fc3-a7afd5840b9d service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-unplugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Instance destroyed successfully.
Nov 28 23:19:34 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'resources' on Instance uuid 4645bea5-5301-4394-9ad8-0bc352a99dda {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1569794857',display_name='tempest-ServerRescueNegativeTestJSON-server-1569794857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1569794857',id=33,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVysS3wm5gNN0sa78SgQSsn8xRGlM6MBHgrhRblr4un5CiVi8uL0dJtSlnH30HwHIymOKFVZsbT5qxsOmGiH4UEop/VlBkYS3j1EyzNlJ0IoLKCaCARh1LupX6FPx3Ang==',key_name='tempest-keypair-30517445',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:15:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-r9arql55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:16:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=4645bea5-5301-4394-9ad8-0bc352a99dda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "address": "fa:16:3e:e7:e9:4f", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf941ff4-5a", "ovs_interfaceid": "bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:4f,bridge_name='br-int',has_traffic_filtering=True,id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf941ff4-5a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG os_vif [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:4f,bridge_name='br-int',has_traffic_filtering=True,id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf941ff4-5a') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf941ff4-5a, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bffb5f34-8fa5-4936-bc57-e46ec79d9235) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:34 user nova-compute[74959]: INFO os_vif [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e9:4f,bridge_name='br-int',has_traffic_filtering=True,id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf941ff4-5a')
Nov 28 23:19:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Deleting instance files /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda_del
Nov 28 23:19:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Deletion of /opt/stack/data/nova/instances/4645bea5-5301-4394-9ad8-0bc352a99dda_del complete
Nov 28 23:19:34 user nova-compute[74959]: INFO nova.compute.manager [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 28 23:19:34 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:19:34 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:19:35 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Took 0.74 seconds to deallocate network for instance.
Nov 28 23:19:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-04be750c-e94d-47c6-981a-117dc4afe9b1 req-dae80bff-c1c4-4d0c-acc9-3ee6d75e942f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-deleted-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:35 user nova-compute[74959]: INFO nova.compute.manager [req-04be750c-e94d-47c6-981a-117dc4afe9b1 req-dae80bff-c1c4-4d0c-acc9-3ee6d75e942f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Neutron deleted interface bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd; detaching it from the instance and deleting it from the info cache
Nov 28 23:19:35 user nova-compute[74959]: DEBUG nova.network.neutron [req-04be750c-e94d-47c6-981a-117dc4afe9b1 req-dae80bff-c1c4-4d0c-acc9-3ee6d75e942f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-04be750c-e94d-47c6-981a-117dc4afe9b1 req-dae80bff-c1c4-4d0c-acc9-3ee6d75e942f service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Detach interface failed, port_id=bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd, reason: Instance 4645bea5-5301-4394-9ad8-0bc352a99dda could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:35 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Deleted allocations for instance 4645bea5-5301-4394-9ad8-0bc352a99dda
Nov 28 23:19:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d145c27b-2e6f-46ce-b759-82a99e17cca3 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-f624eeaa-c45f-4c08-b577-30670ab6d15d req-11f89493-2cd5-43cd-9824-cc2b4ff86b64 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f624eeaa-c45f-4c08-b577-30670ab6d15d req-11f89493-2cd5-43cd-9824-cc2b4ff86b64 service nova] Acquiring lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f624eeaa-c45f-4c08-b577-30670ab6d15d req-11f89493-2cd5-43cd-9824-cc2b4ff86b64 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f624eeaa-c45f-4c08-b577-30670ab6d15d req-11f89493-2cd5-43cd-9824-cc2b4ff86b64 service nova] Lock "4645bea5-5301-4394-9ad8-0bc352a99dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-f624eeaa-c45f-4c08-b577-30670ab6d15d req-11f89493-2cd5-43cd-9824-cc2b4ff86b64 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] No waiting events found dispatching network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:35 user nova-compute[74959]: WARNING nova.compute.manager [req-f624eeaa-c45f-4c08-b577-30670ab6d15d req-11f89493-2cd5-43cd-9824-cc2b4ff86b64 service nova] [instance: 4645bea5-5301-4394-9ad8-0bc352a99dda] Received unexpected event network-vif-plugged-bf941ff4-5a0f-4d94-bb57-fb2c0fe974fd for instance with vm_state deleted and task_state None.
Nov 28 23:19:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-e990aab7-76f4-49c7-a073-932aea7928b1 req-bf0c5cb3-ff9c-4a0d-9f5f-b2b725af7b6a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-e990aab7-76f4-49c7-a073-932aea7928b1 req-bf0c5cb3-ff9c-4a0d-9f5f-b2b725af7b6a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing instance network info cache due to event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:19:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e990aab7-76f4-49c7-a073-932aea7928b1 req-bf0c5cb3-ff9c-4a0d-9f5f-b2b725af7b6a service nova] Acquiring lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:19:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e990aab7-76f4-49c7-a073-932aea7928b1 req-bf0c5cb3-ff9c-4a0d-9f5f-b2b725af7b6a service nova] Acquired lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:19:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-e990aab7-76f4-49c7-a073-932aea7928b1 req-bf0c5cb3-ff9c-4a0d-9f5f-b2b725af7b6a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:19:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-e990aab7-76f4-49c7-a073-932aea7928b1 req-bf0c5cb3-ff9c-4a0d-9f5f-b2b725af7b6a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updated VIF entry in instance network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:19:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-e990aab7-76f4-49c7-a073-932aea7928b1 req-bf0c5cb3-ff9c-4a0d-9f5f-b2b725af7b6a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:19:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e990aab7-76f4-49c7-a073-932aea7928b1 req-bf0c5cb3-ff9c-4a0d-9f5f-b2b725af7b6a service nova] Releasing lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-9aa2fa2f-d2cc-42bc-b03a-b6a8f3766a67 req-582372ae-2f1a-4c9a-9b97-9f4405aab496 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-9aa2fa2f-d2cc-42bc-b03a-b6a8f3766a67 req-582372ae-2f1a-4c9a-9b97-9f4405aab496 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing instance network info cache due to event network-changed-a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9aa2fa2f-d2cc-42bc-b03a-b6a8f3766a67 req-582372ae-2f1a-4c9a-9b97-9f4405aab496 service nova] Acquiring lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9aa2fa2f-d2cc-42bc-b03a-b6a8f3766a67 req-582372ae-2f1a-4c9a-9b97-9f4405aab496 service nova] Acquired lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-9aa2fa2f-d2cc-42bc-b03a-b6a8f3766a67 req-582372ae-2f1a-4c9a-9b97-9f4405aab496 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Refreshing network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:39 user nova-compute[74959]: INFO nova.compute.manager [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Detaching volume 9e47e67d-b848-4532-879e-cbe75f4fdfe7
Nov 28 23:19:39 user nova-compute[74959]: INFO nova.virt.block_device [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Attempting to driver detach volume 9e47e67d-b848-4532-879e-cbe75f4fdfe7 from mountpoint /dev/vdb
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Attempting to detach device vdb from instance 2704bdaf-e70f-469e-9e88-b711b229dd6b from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:19:39 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:19:39 user nova-compute[74959]:   <source dev="/dev/sdd"/>
Nov 28 23:19:39 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:19:39 user nova-compute[74959]:   <serial>9e47e67d-b848-4532-879e-cbe75f4fdfe7</serial>
Nov 28 23:19:39 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:19:39 user nova-compute[74959]: </disk>
Nov 28 23:19:39 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:19:39 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully detached device vdb from instance 2704bdaf-e70f-469e-9e88-b711b229dd6b from the persistent domain config.
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2704bdaf-e70f-469e-9e88-b711b229dd6b from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:19:39 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:19:39 user nova-compute[74959]:   <source dev="/dev/sdd"/>
Nov 28 23:19:39 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:19:39 user nova-compute[74959]:   <serial>9e47e67d-b848-4532-879e-cbe75f4fdfe7</serial>
Nov 28 23:19:39 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:19:39 user nova-compute[74959]: </disk>
Nov 28 23:19:39 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-9aa2fa2f-d2cc-42bc-b03a-b6a8f3766a67 req-582372ae-2f1a-4c9a-9b97-9f4405aab496 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updated VIF entry in instance network info cache for port a2a17a6c-2cde-4c06-bba8-23c3390260e3. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.network.neutron [req-9aa2fa2f-d2cc-42bc-b03a-b6a8f3766a67 req-582372ae-2f1a-4c9a-9b97-9f4405aab496 service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [{"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9aa2fa2f-d2cc-42bc-b03a-b6a8f3766a67 req-582372ae-2f1a-4c9a-9b97-9f4405aab496 service nova] Releasing lock "refresh_cache-2704bdaf-e70f-469e-9e88-b711b229dd6b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:19:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2704bdaf-e70f-469e-9e88-b711b229dd6b {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:19:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "32ab8acf-d827-4043-8435-43d702bd8ea7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:19:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:42 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:19:42 user nova-compute[74959]: INFO nova.compute.claims [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Claim successful on node user
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:19:43 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.policy [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22870bdb55a94a2c938fa2f4b663f09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970869d439544caa9fbc57b53c962c23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:19:43 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Creating image(s)
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "/opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "/opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "/opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk 1073741824" returned: 0 in 0.071s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Successfully created port: adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:19:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Cannot resize image /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Ensure instance console log exists: /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Successfully updated port: adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "refresh_cache-32ab8acf-d827-4043-8435-43d702bd8ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquired lock "refresh_cache-32ab8acf-d827-4043-8435-43d702bd8ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-0914571e-273d-4294-ad20-1ab5181cb106 req-15b2d566-291a-47fd-8859-788a919977f6 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received event network-changed-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-0914571e-273d-4294-ad20-1ab5181cb106 req-15b2d566-291a-47fd-8859-788a919977f6 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Refreshing instance network info cache due to event network-changed-adb6ab30-8ab7-43e9-9c35-a8261d297412. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0914571e-273d-4294-ad20-1ab5181cb106 req-15b2d566-291a-47fd-8859-788a919977f6 service nova] Acquiring lock "refresh_cache-32ab8acf-d827-4043-8435-43d702bd8ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Updating instance_info_cache with network_info: [{"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Releasing lock "refresh_cache-32ab8acf-d827-4043-8435-43d702bd8ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Instance network_info: |[{"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0914571e-273d-4294-ad20-1ab5181cb106 req-15b2d566-291a-47fd-8859-788a919977f6 service nova] Acquired lock "refresh_cache-32ab8acf-d827-4043-8435-43d702bd8ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.neutron [req-0914571e-273d-4294-ad20-1ab5181cb106 req-15b2d566-291a-47fd-8859-788a919977f6 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Refreshing network info cache for port adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Start _get_guest_xml network_info=[{"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:19:44 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:19:44 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-463417566',display_name='tempest-VolumesActionsTest-instance-463417566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-463417566',id=41,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='970869d439544caa9fbc57b53c962c23',ramdisk_id='',reservation_id='r-3q8iymqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-209175437',owner_user_name='tempest-VolumesActionsTest-209175437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:19:43Z,user_data=None,user_id='22870bdb55a94a2c938fa2f4b663f09d',uuid=32ab8acf-d827-4043-8435-43d702bd8ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converting VIF {"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:0c:2c,bridge_name='br-int',has_traffic_filtering=True,id=adb6ab30-8ab7-43e9-9c35-a8261d297412,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6ab30-8a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lazy-loading 'pci_devices' on Instance uuid 32ab8acf-d827-4043-8435-43d702bd8ea7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:19:44 user nova-compute[74959]:   <uuid>32ab8acf-d827-4043-8435-43d702bd8ea7</uuid>
Nov 28 23:19:44 user nova-compute[74959]:   <name>instance-00000029</name>
Nov 28 23:19:44 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:19:44 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:19:44 user nova-compute[74959]:   <metadata>
Nov 28 23:19:44 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:19:44 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:19:44 user nova-compute[74959]:       <nova:name>tempest-VolumesActionsTest-instance-463417566</nova:name>
Nov 28 23:19:44 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:19:44</nova:creationTime>
Nov 28 23:19:44 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:19:44 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:19:44 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:19:44 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:19:44 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:19:44 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:19:44 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:19:44 user nova-compute[74959]:       <nova:owner>
Nov 28 23:19:44 user nova-compute[74959]:         <nova:user uuid="22870bdb55a94a2c938fa2f4b663f09d">tempest-VolumesActionsTest-209175437-project-member</nova:user>
Nov 28 23:19:44 user nova-compute[74959]:         <nova:project uuid="970869d439544caa9fbc57b53c962c23">tempest-VolumesActionsTest-209175437</nova:project>
Nov 28 23:19:44 user nova-compute[74959]:       </nova:owner>
Nov 28 23:19:44 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:19:44 user nova-compute[74959]:       <nova:ports>
Nov 28 23:19:44 user nova-compute[74959]:         <nova:port uuid="adb6ab30-8ab7-43e9-9c35-a8261d297412">
Nov 28 23:19:44 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 23:19:44 user nova-compute[74959]:         </nova:port>
Nov 28 23:19:44 user nova-compute[74959]:       </nova:ports>
Nov 28 23:19:44 user nova-compute[74959]:     </nova:instance>
Nov 28 23:19:44 user nova-compute[74959]:   </metadata>
Nov 28 23:19:44 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:19:44 user nova-compute[74959]:     <system>
Nov 28 23:19:44 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:19:44 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:19:44 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:19:44 user nova-compute[74959]:       <entry name="serial">32ab8acf-d827-4043-8435-43d702bd8ea7</entry>
Nov 28 23:19:44 user nova-compute[74959]:       <entry name="uuid">32ab8acf-d827-4043-8435-43d702bd8ea7</entry>
Nov 28 23:19:44 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:19:44 user nova-compute[74959]:     </system>
Nov 28 23:19:44 user nova-compute[74959]:   </sysinfo>
Nov 28 23:19:44 user nova-compute[74959]:   <os>
Nov 28 23:19:44 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:19:44 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:19:44 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:19:44 user nova-compute[74959]:   </os>
Nov 28 23:19:44 user nova-compute[74959]:   <features>
Nov 28 23:19:44 user nova-compute[74959]:     <acpi/>
Nov 28 23:19:44 user nova-compute[74959]:     <apic/>
Nov 28 23:19:44 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:19:44 user nova-compute[74959]:   </features>
Nov 28 23:19:44 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:19:44 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:19:44 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:19:44 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:19:44 user nova-compute[74959]:   </clock>
Nov 28 23:19:44 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:19:44 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:19:44 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:19:44 user nova-compute[74959]:   </cpu>
Nov 28 23:19:44 user nova-compute[74959]:   <devices>
Nov 28 23:19:44 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:19:44 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:19:44 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk"/>
Nov 28 23:19:44 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:19:44 user nova-compute[74959]:     </disk>
Nov 28 23:19:44 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:19:44 user nova-compute[74959]:       <mac address="fa:16:3e:26:0c:2c"/>
Nov 28 23:19:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:19:44 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:19:44 user nova-compute[74959]:       <target dev="tapadb6ab30-8a"/>
Nov 28 23:19:44 user nova-compute[74959]:     </interface>
Nov 28 23:19:44 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:19:44 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/console.log" append="off"/>
Nov 28 23:19:44 user nova-compute[74959]:     </serial>
Nov 28 23:19:44 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:19:44 user nova-compute[74959]:     <video>
Nov 28 23:19:44 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:19:44 user nova-compute[74959]:     </video>
Nov 28 23:19:44 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:19:44 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:19:44 user nova-compute[74959]:     </rng>
Nov 28 23:19:44 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:19:44 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:19:44 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:19:44 user nova-compute[74959]:     </memballoon>
Nov 28 23:19:44 user nova-compute[74959]:   </devices>
Nov 28 23:19:44 user nova-compute[74959]: </domain>
Nov 28 23:19:44 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-463417566',display_name='tempest-VolumesActionsTest-instance-463417566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-463417566',id=41,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='970869d439544caa9fbc57b53c962c23',ramdisk_id='',reservation_id='r-3q8iymqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-209175437',owner_user_name='tempest-VolumesActionsTest-209175437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:19:43Z,user_data=None,user_id='22870bdb55a94a2c938fa2f4b663f09d',uuid=32ab8acf-d827-4043-8435-43d702bd8ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converting VIF {"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:0c:2c,bridge_name='br-int',has_traffic_filtering=True,id=adb6ab30-8ab7-43e9-9c35-a8261d297412,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6ab30-8a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG os_vif [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:0c:2c,bridge_name='br-int',has_traffic_filtering=True,id=adb6ab30-8ab7-43e9-9c35-a8261d297412,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6ab30-8a') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f20ad2f1-d44b-54eb-a33d-5d57bd21388b', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadb6ab30-8a, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadb6ab30-8a, col_values=(('qos', UUID('ba0b1ca0-adb7-4d57-983b-8eda55d1361f')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadb6ab30-8a, col_values=(('external_ids', {'iface-id': 'adb6ab30-8ab7-43e9-9c35-a8261d297412', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:0c:2c', 'vm-uuid': '32ab8acf-d827-4043-8435-43d702bd8ea7'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:19:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:44 user nova-compute[74959]: INFO os_vif [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:0c:2c,bridge_name='br-int',has_traffic_filtering=True,id=adb6ab30-8ab7-43e9-9c35-a8261d297412,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6ab30-8a')
Nov 28 23:19:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:19:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] No VIF found with MAC fa:16:3e:26:0c:2c, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:19:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-0914571e-273d-4294-ad20-1ab5181cb106 req-15b2d566-291a-47fd-8859-788a919977f6 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Updated VIF entry in instance network info cache for port adb6ab30-8ab7-43e9-9c35-a8261d297412. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:19:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-0914571e-273d-4294-ad20-1ab5181cb106 req-15b2d566-291a-47fd-8859-788a919977f6 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Updating instance_info_cache with network_info: [{"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:19:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0914571e-273d-4294-ad20-1ab5181cb106 req-15b2d566-291a-47fd-8859-788a919977f6 service nova] Releasing lock "refresh_cache-32ab8acf-d827-4043-8435-43d702bd8ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:19:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:45 user nova-compute[74959]: INFO nova.compute.manager [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Detaching volume 2f456504-3aa8-489c-9686-e2602fcae271
Nov 28 23:19:45 user nova-compute[74959]: INFO nova.virt.block_device [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attempting to driver detach volume 2f456504-3aa8-489c-9686-e2602fcae271 from mountpoint /dev/vdb
Nov 28 23:19:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Attempting to detach device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:19:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:19:45 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:19:45 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:19:45 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:19:45 user nova-compute[74959]:   <serial>2f456504-3aa8-489c-9686-e2602fcae271</serial>
Nov 28 23:19:45 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:19:45 user nova-compute[74959]: </disk>
Nov 28 23:19:45 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:19:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully detached device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the persistent domain config.
Nov 28 23:19:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:19:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:19:45 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:19:45 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:19:45 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:19:45 user nova-compute[74959]:   <serial>2f456504-3aa8-489c-9686-e2602fcae271</serial>
Nov 28 23:19:45 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:19:45 user nova-compute[74959]: </disk>
Nov 28 23:19:45 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-1dd843c8-be81-47d3-b068-7e700a87c9c3 req-1f9773be-157e-452a-b6bf-a67fb01fd322 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received event network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1dd843c8-be81-47d3-b068-7e700a87c9c3 req-1f9773be-157e-452a-b6bf-a67fb01fd322 service nova] Acquiring lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1dd843c8-be81-47d3-b068-7e700a87c9c3 req-1f9773be-157e-452a-b6bf-a67fb01fd322 service nova] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1dd843c8-be81-47d3-b068-7e700a87c9c3 req-1f9773be-157e-452a-b6bf-a67fb01fd322 service nova] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-1dd843c8-be81-47d3-b068-7e700a87c9c3 req-1f9773be-157e-452a-b6bf-a67fb01fd322 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] No waiting events found dispatching network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:46 user nova-compute[74959]: WARNING nova.compute.manager [req-1dd843c8-be81-47d3-b068-7e700a87c9c3 req-1f9773be-157e-452a-b6bf-a67fb01fd322 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received unexpected event network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 for instance with vm_state building and task_state spawning.
Nov 28 23:19:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:19:48 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Instance spawned successfully.
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-fe0eff76-51db-46ea-a0b2-bf6160751df1 req-8e8f326d-eec0-416d-930d-350812323ab8 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received event network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe0eff76-51db-46ea-a0b2-bf6160751df1 req-8e8f326d-eec0-416d-930d-350812323ab8 service nova] Acquiring lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe0eff76-51db-46ea-a0b2-bf6160751df1 req-8e8f326d-eec0-416d-930d-350812323ab8 service nova] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fe0eff76-51db-46ea-a0b2-bf6160751df1 req-8e8f326d-eec0-416d-930d-350812323ab8 service nova] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-fe0eff76-51db-46ea-a0b2-bf6160751df1 req-8e8f326d-eec0-416d-930d-350812323ab8 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] No waiting events found dispatching network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:19:48 user nova-compute[74959]: WARNING nova.compute.manager [req-fe0eff76-51db-46ea-a0b2-bf6160751df1 req-8e8f326d-eec0-416d-930d-350812323ab8 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received unexpected event network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 for instance with vm_state building and task_state spawning.
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:19:48 user nova-compute[74959]: INFO nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 28 23:19:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:19:49 user nova-compute[74959]: INFO nova.compute.manager [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Took 6.30 seconds to build instance.
Nov 28 23:19:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9145051e-16c3-44da-a256-f0b13e194f8b tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.401s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:19:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:19:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:19:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:19:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=7752MB free_disk=25.066146850585938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 82c0be4a-fbed-41e9-861b-c567fb67b696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 2704bdaf-e70f-469e-9e88-b711b229dd6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 15eae952-f2b9-4762-8daf-ef551b24931d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7bce9741-61f6-4141-be40-e779d536fa0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 32ab8acf-d827-4043-8435-43d702bd8ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:19:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2704bdaf-e70f-469e-9e88-b711b229dd6b is timed out.
Nov 28 23:19:59 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully detached device vdb from instance 2704bdaf-e70f-469e-9e88-b711b229dd6b from the live domain config.
Nov 28 23:19:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBLTrplY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:19:59 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:19:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f974d5f-f2eb-4d65-b636-16acd842f67b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:19:59 user nova-compute[74959]: No targets found.
Nov 28 23:19:59 user nova-compute[74959]: iSNS:
Nov 28 23:19:59 user nova-compute[74959]: No targets found.
Nov 28 23:19:59 user nova-compute[74959]: STATIC:
Nov 28 23:19:59 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7
Nov 28 23:19:59 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:19:59 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:19:59 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:19:59 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:19:59 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:19:59 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271
Nov 28 23:19:59 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:19:59 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:19:59 user nova-compute[74959]: FIRMWARE:
Nov 28 23:19:59 user nova-compute[74959]: No targets found.
Nov 28 23:19:59 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:19:59 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:19:59 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:19:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1401a1-e247-4c0d-b5c6-b2c22c8fbceb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cd2992-0ef0-41e7-a274-40b616e70d55]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:20:00 user nova-compute[74959]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:00 user nova-compute[74959]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)
Nov 28 23:20:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 (non-flash)
Nov 28 23:20:00 user nova-compute[74959]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:00 user nova-compute[74959]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)
Nov 28 23:20:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec36f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7'): ({'sdd'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Removing single pathed devices sdd {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[af35cc35-2d14-4c8e-a6e5-a562b696c545]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf19968-4830-4de8-a10c-4f45f949614b]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Flushing IO for device /dev/sdd {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfcbc83-7b87-4279-abf6-01132df4ad44]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a493383-4835-477e-89d8-5efcb2f06ec4]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[682da0ef-3787-4025-a478-83ae702a894c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f9a992-e75e-422c-95fc-3e71a0d6e795]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7, portal: 172.16.0.220,3260]
Nov 28 23:20:00 user nova-compute[74959]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7, portal: 172.16.0.220,3260] successful.
Nov 28 23:20:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47e67d-b848-4532-879e-cbe75f4fdfe7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfbff2e-b86c-4a44-b2bc-e0cb8b4c81b9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] <== disconnect_volume: return (314ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:20:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'flavor' on Instance uuid 2704bdaf-e70f-469e-9e88-b711b229dd6b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a299df62-f877-47e2-8e95-d1cc11cdd35e tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.851s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:20:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15eae952-f2b9-4762-8daf-ef551b24931d is timed out.
Nov 28 23:20:06 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully detached device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the live domain config.
Nov 28 23:20:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWFnBRHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:20:06 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33c823-9171-44df-9f3b-3c9d89ec0f34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:20:06 user nova-compute[74959]: No targets found.
Nov 28 23:20:06 user nova-compute[74959]: iSNS:
Nov 28 23:20:06 user nova-compute[74959]: No targets found.
Nov 28 23:20:06 user nova-compute[74959]: STATIC:
Nov 28 23:20:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:20:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:20:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:20:06 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271
Nov 28 23:20:06 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:20:06 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:20:06 user nova-compute[74959]: FIRMWARE:
Nov 28 23:20:06 user nova-compute[74959]: No targets found.
Nov 28 23:20:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:20:06 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:20:06 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b44212-9cc0-44d8-b1e5-8eeb846155a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c615224d-32b2-427d-baba-0b19416f385f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:06 user nova-compute[74959]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)
Nov 28 23:20:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:06 user nova-compute[74959]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 (non-flash)
Nov 28 23:20:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec36cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271'): ({'sdc'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Removing single pathed devices sdc {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91eeca-52fe-42a9-8deb-95227dd5d978]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5031f1e2-697b-49bf-91ab-a57686a99331]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Flushing IO for device /dev/sdc {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b167edc8-ece2-4646-877e-22c5f170ab31]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b893fa-d425-4809-af17-422a8f0d96ea]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce70b2a-3f15-45ff-9261-b02d562a4826]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fc520d-81ca-4918-9baa-87f171ca28d5]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:06 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271, portal: 172.16.0.220,3260]
Nov 28 23:20:06 user nova-compute[74959]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271, portal: 172.16.0.220,3260] successful.
Nov 28 23:20:06 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f456504-3aa8-489c-9686-e2602fcae271 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef6676c-1081-40a9-97f2-a5e01ee5030c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== disconnect_volume: return (286ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3b8355c3-f9fb-4107-bd9c-d5b5c684b4ee tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.149s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:20:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:20:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:31 user nova-compute[74959]: INFO nova.compute.manager [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Terminating instance
Nov 28 23:20:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-97ea9a20-aece-4163-b70b-6a0d47af1542 req-b6f309f3-74f4-4368-a9b7-715d99c298f0 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-unplugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-97ea9a20-aece-4163-b70b-6a0d47af1542 req-b6f309f3-74f4-4368-a9b7-715d99c298f0 service nova] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-97ea9a20-aece-4163-b70b-6a0d47af1542 req-b6f309f3-74f4-4368-a9b7-715d99c298f0 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-97ea9a20-aece-4163-b70b-6a0d47af1542 req-b6f309f3-74f4-4368-a9b7-715d99c298f0 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-97ea9a20-aece-4163-b70b-6a0d47af1542 req-b6f309f3-74f4-4368-a9b7-715d99c298f0 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] No waiting events found dispatching network-vif-unplugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-97ea9a20-aece-4163-b70b-6a0d47af1542 req-b6f309f3-74f4-4368-a9b7-715d99c298f0 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-unplugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:32 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Instance destroyed successfully.
Nov 28 23:20:32 user nova-compute[74959]: DEBUG nova.objects.instance [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'resources' on Instance uuid 82c0be4a-fbed-41e9-861b-c567fb67b696 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-214754837',display_name='tempest-ServerRescueNegativeTestJSON-server-214754837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-214754837',id=19,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:06:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-nbpc56z6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:06:09Z,user_data=None,user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=82c0be4a-fbed-41e9-861b-c567fb67b696,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "address": "fa:16:3e:bf:9e:90", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc72f2fc-0f", "ovs_interfaceid": "cc72f2fc-0fc3-4aef-9d98-e2a77342845d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:9e:90,bridge_name='br-int',has_traffic_filtering=True,id=cc72f2fc-0fc3-4aef-9d98-e2a77342845d,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc72f2fc-0f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG os_vif [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:9e:90,bridge_name='br-int',has_traffic_filtering=True,id=cc72f2fc-0fc3-4aef-9d98-e2a77342845d,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc72f2fc-0f') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc72f2fc-0f, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85e2e368-24f2-44d9-a71a-b9bf7e62c9e1) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:20:32 user nova-compute[74959]: INFO os_vif [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:9e:90,bridge_name='br-int',has_traffic_filtering=True,id=cc72f2fc-0fc3-4aef-9d98-e2a77342845d,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc72f2fc-0f')
Nov 28 23:20:32 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Deleting instance files /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696_del
Nov 28 23:20:32 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Deletion of /opt/stack/data/nova/instances/82c0be4a-fbed-41e9-861b-c567fb67b696_del complete
Nov 28 23:20:32 user nova-compute[74959]: INFO nova.compute.manager [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 28 23:20:32 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:32 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Took 0.59 seconds to deallocate network for instance.
Nov 28 23:20:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-505e025a-4e66-47fe-ba8b-4005b9b2a312 req-6a95de5f-b0b3-40ec-b618-a58f8f5dd67d service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-deleted-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:33 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:20:33 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:20:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:33 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Deleted allocations for instance 82c0be4a-fbed-41e9-861b-c567fb67b696
Nov 28 23:20:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-bb5f9850-3890-47ff-9be0-947547988c69 tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.076s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-007b5db3-0171-47a1-b2f9-37aee2ce8ce0 req-6cd9e5b2-1fec-43d3-a74e-4298ef565aa9 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-007b5db3-0171-47a1-b2f9-37aee2ce8ce0 req-6cd9e5b2-1fec-43d3-a74e-4298ef565aa9 service nova] Acquiring lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-007b5db3-0171-47a1-b2f9-37aee2ce8ce0 req-6cd9e5b2-1fec-43d3-a74e-4298ef565aa9 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-007b5db3-0171-47a1-b2f9-37aee2ce8ce0 req-6cd9e5b2-1fec-43d3-a74e-4298ef565aa9 service nova] Lock "82c0be4a-fbed-41e9-861b-c567fb67b696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-007b5db3-0171-47a1-b2f9-37aee2ce8ce0 req-6cd9e5b2-1fec-43d3-a74e-4298ef565aa9 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] No waiting events found dispatching network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:20:33 user nova-compute[74959]: WARNING nova.compute.manager [req-007b5db3-0171-47a1-b2f9-37aee2ce8ce0 req-6cd9e5b2-1fec-43d3-a74e-4298ef565aa9 service nova] [instance: 82c0be4a-fbed-41e9-861b-c567fb67b696] Received unexpected event network-vif-plugged-cc72f2fc-0fc3-4aef-9d98-e2a77342845d for instance with vm_state deleted and task_state None.
Nov 28 23:20:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:34 user nova-compute[74959]: INFO nova.compute.manager [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Terminating instance
Nov 28 23:20:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:20:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:35 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Instance destroyed successfully.
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.objects.instance [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lazy-loading 'resources' on Instance uuid 2704bdaf-e70f-469e-9e88-b711b229dd6b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1541535247',display_name='tempest-TestMinimumBasicScenario-server-1541535247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1541535247',id=36,image_ref='5043ed02-2334-4e3d-88aa-8c981af72663',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4CzHNiRuySWSAK+eIKs6fm1TVCxQ9WzZc5P+ymVAtljef1RJckew0PIYOFxhMU+2wPhZDs1v966+XQ4w3F6XirgpFdgkgH3+mThCFMFP6RgcC5bpOPww69rcm5YUrSAw==',key_name='tempest-TestMinimumBasicScenario-1531585152',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:15:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b94592793a8e4345b9357f03062cca9a',ramdisk_id='',reservation_id='r-xo6rn83t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5043ed02-2334-4e3d-88aa-8c981af72663',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-615443694',owner_user_name='tempest-TestMinimumBasicScenario-615443694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:17:54Z,user_data=None,user_id='d3b7bfca433f4f1ab07b34aa3b5faa42',uuid=2704bdaf-e70f-469e-9e88-b711b229dd6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converting VIF {"id": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "address": "fa:16:3e:df:f5:d8", "network": {"id": "182b0a3d-4e66-4a3b-9d57-5cfd316433cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1849409652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b94592793a8e4345b9357f03062cca9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2a17a6c-2c", "ovs_interfaceid": "a2a17a6c-2cde-4c06-bba8-23c3390260e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:f5:d8,bridge_name='br-int',has_traffic_filtering=True,id=a2a17a6c-2cde-4c06-bba8-23c3390260e3,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a17a6c-2c') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG os_vif [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:f5:d8,bridge_name='br-int',has_traffic_filtering=True,id=a2a17a6c-2cde-4c06-bba8-23c3390260e3,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a17a6c-2c') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2a17a6c-2c, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6bc3372-576f-45ed-90e1-821a5d71a253) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:35 user nova-compute[74959]: INFO os_vif [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:f5:d8,bridge_name='br-int',has_traffic_filtering=True,id=a2a17a6c-2cde-4c06-bba8-23c3390260e3,network=Network(182b0a3d-4e66-4a3b-9d57-5cfd316433cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2a17a6c-2c')
Nov 28 23:20:35 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Deleting instance files /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b_del
Nov 28 23:20:35 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Deletion of /opt/stack/data/nova/instances/2704bdaf-e70f-469e-9e88-b711b229dd6b_del complete
Nov 28 23:20:35 user nova-compute[74959]: INFO nova.compute.manager [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:35 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Took 0.39 seconds to deallocate network for instance.
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-084e144c-6f45-437d-b1b6-275f0d55f90a req-ca03d3b8-e7f8-40ff-8571-cd8ce591e37f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-deleted-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:35 user nova-compute[74959]: INFO nova.compute.manager [req-084e144c-6f45-437d-b1b6-275f0d55f90a req-ca03d3b8-e7f8-40ff-8571-cd8ce591e37f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Neutron deleted interface a2a17a6c-2cde-4c06-bba8-23c3390260e3; detaching it from the instance and deleting it from the info cache
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.network.neutron [req-084e144c-6f45-437d-b1b6-275f0d55f90a req-ca03d3b8-e7f8-40ff-8571-cd8ce591e37f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-084e144c-6f45-437d-b1b6-275f0d55f90a req-ca03d3b8-e7f8-40ff-8571-cd8ce591e37f service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Detach interface failed, port_id=a2a17a6c-2cde-4c06-bba8-23c3390260e3, reason: Instance 2704bdaf-e70f-469e-9e88-b711b229dd6b could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:35 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Deleted allocations for instance 2704bdaf-e70f-469e-9e88-b711b229dd6b
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-unplugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] No waiting events found dispatching network-vif-unplugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:20:35 user nova-compute[74959]: WARNING nova.compute.manager [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received unexpected event network-vif-unplugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 for instance with vm_state deleted and task_state None.
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] Acquiring lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] No waiting events found dispatching network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:20:35 user nova-compute[74959]: WARNING nova.compute.manager [req-259acd8d-9990-4e4b-a9c8-b711b443e121 req-33b2e408-c267-4751-af92-50ee4504624a service nova] [instance: 2704bdaf-e70f-469e-9e88-b711b229dd6b] Received unexpected event network-vif-plugged-a2a17a6c-2cde-4c06-bba8-23c3390260e3 for instance with vm_state deleted and task_state None.
Nov 28 23:20:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-020caff9-72b4-4495-a7d8-5ce27b513dc5 tempest-TestMinimumBasicScenario-615443694 tempest-TestMinimumBasicScenario-615443694-project-member] Lock "2704bdaf-e70f-469e-9e88-b711b229dd6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.777s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:38 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:39 user nova-compute[74959]: INFO nova.compute.manager [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attaching volume fb3dd66f-4bc6-421b-8b0c-d9695a266898 to /dev/vdb
Nov 28 23:20:39 user nova-compute[74959]: DEBUG os_brick.utils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a1428-2cd8-4496-b568-1f9098d50c48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b89c321-8c23-4309-8723-c45c3c775a75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f836f759-5e45-4b63-94f7-92bdb197b362]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa8233-29af-42ab-a7bb-39e0de949b81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:20:39 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:20:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a92f4-63a5-4f44-a0c3-c7bee8aaed89]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG os_brick.utils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:20:39 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating existing volume attachment record: 2088a8b5-7425-4fd7-8bcb-8600e6c25694 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:20:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-1707a0e1-d567-4f04-a3c0-b14242efb18b req-86adee7e-5977-4e78-8d00-203b65dbb85f service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received event network-changed-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:44 user nova-compute[74959]: DEBUG nova.compute.manager [req-1707a0e1-d567-4f04-a3c0-b14242efb18b req-86adee7e-5977-4e78-8d00-203b65dbb85f service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Refreshing instance network info cache due to event network-changed-6d5f273c-1220-4e91-9659-59b5178d669a. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:20:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1707a0e1-d567-4f04-a3c0-b14242efb18b req-86adee7e-5977-4e78-8d00-203b65dbb85f service nova] Acquiring lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:20:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1707a0e1-d567-4f04-a3c0-b14242efb18b req-86adee7e-5977-4e78-8d00-203b65dbb85f service nova] Acquired lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:20:44 user nova-compute[74959]: DEBUG nova.network.neutron [req-1707a0e1-d567-4f04-a3c0-b14242efb18b req-86adee7e-5977-4e78-8d00-203b65dbb85f service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Refreshing network info cache for port 6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:20:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'flavor' on Instance uuid 7bce9741-61f6-4141-be40-e779d536fa0a {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Ignoring supplied device name: /dev/vdb
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:45 user nova-compute[74959]: INFO nova.compute.manager [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Attaching volume 77a4d651-dbd9-4750-833a-91f1e9240473 to /dev/vdb
Nov 28 23:20:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-1707a0e1-d567-4f04-a3c0-b14242efb18b req-86adee7e-5977-4e78-8d00-203b65dbb85f service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Updated VIF entry in instance network info cache for port 6d5f273c-1220-4e91-9659-59b5178d669a. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG nova.network.neutron [req-1707a0e1-d567-4f04-a3c0-b14242efb18b req-86adee7e-5977-4e78-8d00-203b65dbb85f service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Updating instance_info_cache with network_info: [{"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1707a0e1-d567-4f04-a3c0-b14242efb18b req-86adee7e-5977-4e78-8d00-203b65dbb85f service nova] Releasing lock "refresh_cache-7bce9741-61f6-4141-be40-e779d536fa0a" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG os_brick.utils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d376695-a534-48ba-a535-37c36f8ca4b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f478b8-aae1-4337-9024-6621af12a4a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6a6f64-2f39-4ba7-ab2b-94ea3df2959f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d552e-3595-4eb9-ab14-acbf4da2c648]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:20:45 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:20:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a284625-cf9b-4a4c-90d8-2a3d3389bc8c]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG os_brick.utils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:20:45 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Updating existing volume attachment record: eb2b34cb-dd9c-413b-b114-3c34ff6267d4 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-1211ee72-3461-4e6e-8ba1-993281030cfe req-a6d23679-7a75-4025-bd92-b81077ca77eb service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-changed-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG nova.compute.manager [req-1211ee72-3461-4e6e-8ba1-993281030cfe req-a6d23679-7a75-4025-bd92-b81077ca77eb service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Refreshing instance network info cache due to event network-changed-72a7bc36-1b60-4142-885f-33c78bb17209. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1211ee72-3461-4e6e-8ba1-993281030cfe req-a6d23679-7a75-4025-bd92-b81077ca77eb service nova] Acquiring lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1211ee72-3461-4e6e-8ba1-993281030cfe req-a6d23679-7a75-4025-bd92-b81077ca77eb service nova] Acquired lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG nova.network.neutron [req-1211ee72-3461-4e6e-8ba1-993281030cfe req-a6d23679-7a75-4025-bd92-b81077ca77eb service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Refreshing network info cache for port 72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSmZcLag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:20:46 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:20:46 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:20:46 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[44367941-1087-44a7-98fb-bca4590f4d54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:20:46 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[10521b08-f3b1-45c6-b2b1-6e239ade51e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898] added
Nov 28 23:20:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e2624b-044e-4550-a44b-a04ff516f252]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa001388-5f65-427e-b982-50159d0f1437]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSmZcLag {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSmZcLag" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0918f7-67c3-4d8e-8f7e-9d0455ece6b2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSmZcLag'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a0e3e-27a1-4b80-908b-198767f73be3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3334ac-43ac-4a09-87bc-3e3166bba21b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589700a-eff1-4f16-9272-eee8c4ddc3aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898, portal: 172.16.0.220,3260]
Nov 28 23:20:46 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898, portal: 172.16.0.220,3260] successful.
Nov 28 23:20:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG nova.network.neutron [req-1211ee72-3461-4e6e-8ba1-993281030cfe req-a6d23679-7a75-4025-bd92-b81077ca77eb service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updated VIF entry in instance network info cache for port 72a7bc36-1b60-4142-885f-33c78bb17209. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG nova.network.neutron [req-1211ee72-3461-4e6e-8ba1-993281030cfe req-a6d23679-7a75-4025-bd92-b81077ca77eb service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updating instance_info_cache with network_info: [{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f55fce-b6cf-46f1-8e1d-32c6b06a15bf]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1211ee72-3461-4e6e-8ba1-993281030cfe req-a6d23679-7a75-4025-bd92-b81077ca77eb service nova] Releasing lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27f4509-2a9d-4e55-91c2-70382301781a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:46 user nova-compute[74959]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:20:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:46 user nova-compute[74959]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:20:46 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69830da-cabd-4c36-814d-09dba4c15fa3]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSmZcLag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:20:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23631313632613539', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631313632613539', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:20:47 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:20:47 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:20:47 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:20:47 user nova-compute[74959]:   <serial>fb3dd66f-4bc6-421b-8b0c-d9695a266898</serial>
Nov 28 23:20:47 user nova-compute[74959]: </disk>
Nov 28 23:20:47 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Stashing vm_state: active {{(pid=74959) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:47 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:20:47 user nova-compute[74959]: INFO nova.compute.claims [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Claim successful on node user
Nov 28 23:20:48 user nova-compute[74959]: INFO nova.compute.resource_tracker [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating resource usage from migration a73d6c44-7730-4d98-9676-567d8df31291
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No VIF found with MAC fa:16:3e:49:71:8b, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-98377dd1-207a-4c6f-9f31-71b6677e5503 req-7718e91b-4f1a-4b6c-b1be-407439863961 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-changed-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.compute.manager [req-98377dd1-207a-4c6f-9f31-71b6677e5503 req-7718e91b-4f1a-4b6c-b1be-407439863961 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Refreshing instance network info cache due to event network-changed-b3bc71e3-1363-4d17-bb0a-89df3579237f. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-98377dd1-207a-4c6f-9f31-71b6677e5503 req-7718e91b-4f1a-4b6c-b1be-407439863961 service nova] Acquiring lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-98377dd1-207a-4c6f-9f31-71b6677e5503 req-7718e91b-4f1a-4b6c-b1be-407439863961 service nova] Acquired lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-98377dd1-207a-4c6f-9f31-71b6677e5503 req-7718e91b-4f1a-4b6c-b1be-407439863961 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Refreshing network info cache for port b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ffa41a1a-e087-4474-bde0-885a5fafa7a3 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.251s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.376s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:48 user nova-compute[74959]: INFO nova.compute.manager [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Migrating
Nov 28 23:20:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-98377dd1-207a-4c6f-9f31-71b6677e5503 req-7718e91b-4f1a-4b6c-b1be-407439863961 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updated VIF entry in instance network info cache for port b3bc71e3-1363-4d17-bb0a-89df3579237f. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-98377dd1-207a-4c6f-9f31-71b6677e5503 req-7718e91b-4f1a-4b6c-b1be-407439863961 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating instance_info_cache with network_info: [{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-98377dd1-207a-4c6f-9f31-71b6677e5503 req-7718e91b-4f1a-4b6c-b1be-407439863961 service nova] Releasing lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquired lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:20:48 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:20:49 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating instance_info_cache with network_info: [{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Releasing lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:20:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Starting migrate_disk_and_power_off {{(pid=74959) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 23:20:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-unplugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] No waiting events found dispatching network-vif-unplugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:20:50 user nova-compute[74959]: WARNING nova.compute.manager [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received unexpected event network-vif-unplugged-b3bc71e3-1363-4d17-bb0a-89df3579237f for instance with vm_state active and task_state resize_migrating.
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.compute.manager [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] No waiting events found dispatching network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:20:50 user nova-compute[74959]: WARNING nova.compute.manager [req-0f0283e3-61b3-45aa-bceb-8505773d0580 req-694f828a-abea-4783-a629-02227e9d522d service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received unexpected event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f for instance with vm_state active and task_state resize_migrating.
Nov 28 23:20:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance destroyed successfully.
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1289172084',display_name='tempest-ServerActionsTestOtherA-server-1289172084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1289172084',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-s1z8orwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6533acac-8b30-4eb5-ba8f-16560e1d5af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-651875965-network", "vif_mac": "fa:16:3e:b9:d3:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-651875965-network", "vif_mac": "fa:16:3e:b9:d3:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_vif [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3bc71e3-13, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=747ba156-1829-4717-9463-5df9350324ae) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:50 user nova-compute[74959]: INFO os_vif [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13')
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKcEqOsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:20:50 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12e47c6-a79c-4fbc-aeec-d2056181a9ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:20:50 user nova-compute[74959]: No targets found.
Nov 28 23:20:50 user nova-compute[74959]: iSNS:
Nov 28 23:20:50 user nova-compute[74959]: No targets found.
Nov 28 23:20:50 user nova-compute[74959]: STATIC:
Nov 28 23:20:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898
Nov 28 23:20:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:20:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:20:50 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:20:50 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:20:50 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:20:50 user nova-compute[74959]: FIRMWARE:
Nov 28 23:20:50 user nova-compute[74959]: No targets found.
Nov 28 23:20:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:20:50 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:20:50 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49a222e-90f6-4b90-a668-de73345d3060]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ed0c95-c328-4f70-9584-645959ef54f8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:50 user nova-compute[74959]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:20:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:20:50 user nova-compute[74959]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:20:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc7c5480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b97c0a4-90cb-4bb9-9653-b7e0d29e0f57]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5575ea6d-d1af-4b71-bd25-ffd83bb49980]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac510651-791a-4cb2-94d3-a7a095a22c73]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[42808991-2a20-4e7d-93f0-6d9c2287494b]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3b12a42b', '/dev/disk/by-id/scsi-1SCST_BIO3b12a42b-91e349517582ec82', '/dev/disk/by-id/scsi-23931653334393531') {{(pid=86637) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a09d2fe-439f-4040-901f-07b9b5b5103b]: (4, None) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb2ab8-bc97-49ae-857b-b23eed46c904]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --logout" returned: 0 in 0.190s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[89608028-e51e-43fe-aa20-e6205555c9d1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260]
Nov 28 23:20:50 user nova-compute[74959]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260] successful.
Nov 28 23:20:50 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:50 user nova-compute[74959]: INFO nova.compute.manager [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Detaching volume fb3dd66f-4bc6-421b-8b0c-d9695a266898
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d7509f-e592-4527-8377-13f276878336]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== disconnect_volume: return (497ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:20:50 user nova-compute[74959]: INFO nova.virt.block_device [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attempting to driver detach volume fb3dd66f-4bc6-421b-8b0c-d9695a266898 from mountpoint /dev/vdb
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Attempting to detach device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:20:50 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:20:50 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:20:50 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:20:50 user nova-compute[74959]:   <serial>fb3dd66f-4bc6-421b-8b0c-d9695a266898</serial>
Nov 28 23:20:50 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:20:50 user nova-compute[74959]: </disk>
Nov 28 23:20:50 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:20:50 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully detached device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the persistent domain config.
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:20:50 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:20:50 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:20:50 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:20:50 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:20:50 user nova-compute[74959]:   <serial>fb3dd66f-4bc6-421b-8b0c-d9695a266898</serial>
Nov 28 23:20:50 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:20:50 user nova-compute[74959]: </disk>
Nov 28 23:20:50 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:20:51 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updating instance_info_cache with network_info: [{"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-5d351a14-fe3f-4c98-833c-cdff15e5831b" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:20:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:20:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:20:51 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Port b3bc71e3-1363-4d17-bb0a-89df3579237f binding to destination host user is already ACTIVE {{(pid=74959) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 23:20:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquired lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating instance_info_cache with network_info: [{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Releasing lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG os_brick.utils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3dfa1d-2243-498e-9d89-9cb33dcae0dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[51731da1-bccb-4ba6-a57e-39727e4beee6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83d24d7-e31c-42be-b1de-5330f0119b03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ec450c-9669-4525-a70c-cb4cb3020b82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:20:52 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:20:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8af2ac-3981-475d-a0ec-f5da0c90e1a8]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:20:52 user nova-compute[74959]: DEBUG os_brick.utils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsORMuJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:20:53 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:20:53 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:20:53 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[622121cb-9472-4292-a7cd-506cdd75bc61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:20:53 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4fdbf2-9f02-42db-96be-8dc5c565fbc0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473] added
Nov 28 23:20:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6098b9-127b-4bec-8f79-4b77addd2849]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[817b2a8a-75d2-42dc-8363-6de1215e2890]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsORMuJH {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsORMuJH" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0073f116-cbc0-437a-a222-f2e78db7f078]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WsORMuJH'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e32fbb-aa36-467b-919e-70ece9630aef]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478428d-694b-4695-b930-afc2e8e075bd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:20:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:20:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b83253-115c-40a9-9484-4d3155b9ffe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473, portal: 172.16.0.220,3260]
Nov 28 23:20:53 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473, portal: 172.16.0.220,3260] successful.
Nov 28 23:20:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ebdc17-49ff-4f64-af61-cf657bdd932e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf01393-5cf4-43a7-907e-e08f751b5552]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:20:53 user nova-compute[74959]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:20:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:20:53 user nova-compute[74959]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:20:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb903b68-13b2-42ff-a0d4-2a15deaf2268]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsORMuJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26266333162306366', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266333162306366', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'flavor' on Instance uuid 7bce9741-61f6-4141-be40-e779d536fa0a {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:20:54 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:20:54 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:20:54 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:20:54 user nova-compute[74959]:   <serial>77a4d651-dbd9-4750-833a-91f1e9240473</serial>
Nov 28 23:20:54 user nova-compute[74959]: </disk>
Nov 28 23:20:54 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:20:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] No VIF found with MAC fa:16:3e:7f:fc:c7, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-04bd6f9d-15f6-4761-a1e2-963b2e326610 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.807s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:55 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:56 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:20:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:20:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8188MB free_disk=25.083091735839844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Applying migration context for instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 as it has an incoming, in-progress migration a73d6c44-7730-4d98-9676-567d8df31291. Migration status is post-migrating {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 23:20:58 user nova-compute[74959]: INFO nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating resource usage from migration a73d6c44-7730-4d98-9676-567d8df31291
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 5d351a14-fe3f-4c98-833c-cdff15e5831b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 15eae952-f2b9-4762-8daf-ef551b24931d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 7bce9741-61f6-4141-be40-e779d536fa0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 32ab8acf-d827-4043-8435-43d702bd8ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Migration a73d6c44-7730-4d98-9676-567d8df31291 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:20:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:20:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:20:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:20:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Starting finish_migration {{(pid=74959) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance directory exists: not creating {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 23:21:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Creating image(s)
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Ensure instance console log exists: /opt/stack/data/nova/instances/6533acac-8b30-4eb5-ba8f-16560e1d5af7/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Start _get_guest_xml network_info=[{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-651875965-network", "vif_mac": "fa:16:3e:b9:d3:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKcEqOsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6533acac-8b30-4eb5-ba8f-16560e1d5af7', 'attached_at': '2023-11-28T23:21:00.000000', 'detached_at': '', 'volume_id': 'd26f5e53-5dd4-4660-94a5-5887fc2f85db', 'serial': 'd26f5e53-5dd4-4660-94a5-5887fc2f85db'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '4e6f374b-4daa-402d-8198-94d314f719a1', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:21:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:21:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKcEqOsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:21:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:21:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:21:00 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d6b565-73ed-4d07-b712-ce2ce82af6fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:21:00 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5361db92-b78d-47c0-ae50-808ec0fc4f66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db] added
Nov 28 23:21:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8287eefe-e0c3-4b69-8b04-8f36e51f6e64]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd44dad-69aa-4e35-b823-3c7bdfafdf29]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKcEqOsN {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKcEqOsN" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ab97f2-5720-4338-bee2-7be1db798d6b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKcEqOsN'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d91b3f-15f5-415b-b77c-d3312c1c5ff2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbfd0da-7bdc-463e-82a2-1191a3b47059]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:21:00 user nova-compute[74959]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:21:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:21:00 user nova-compute[74959]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:21:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[03de2359-b420-46b4-a011-10a8d3a42054]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260]
Nov 28 23:21:00 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260] successful.
Nov 28 23:21:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb80fd-cbc1-4bbd-a1fc-152c99464455]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb5df3-ac11-4c4a-a349-b82a7abcc451]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:21:00 user nova-compute[74959]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:21:00 user nova-compute[74959]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:21:00 user nova-compute[74959]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:21:00 user nova-compute[74959]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e0c89-ee77-45f0-8ae7-ea13222de661]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKcEqOsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23931653334393531', 'path': '/dev/sdd'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653334393531', 'path': '/dev/sdd'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1289172084',display_name='tempest-ServerActionsTestOtherA-server-1289172084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1289172084',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-s1z8orwi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6533acac-8b30-4eb5-ba8f-16560e1d5af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-651875965-network", "vif_mac": "fa:16:3e:b9:d3:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-651875965-network", "vif_mac": "fa:16:3e:b9:d3:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:21:01 user nova-compute[74959]:   <uuid>6533acac-8b30-4eb5-ba8f-16560e1d5af7</uuid>
Nov 28 23:21:01 user nova-compute[74959]:   <name>instance-00000028</name>
Nov 28 23:21:01 user nova-compute[74959]:   <memory>2097152</memory>
Nov 28 23:21:01 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:21:01 user nova-compute[74959]:   <metadata>
Nov 28 23:21:01 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:21:01 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:21:01 user nova-compute[74959]:       <nova:name>tempest-ServerActionsTestOtherA-server-1289172084</nova:name>
Nov 28 23:21:01 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:21:00</nova:creationTime>
Nov 28 23:21:01 user nova-compute[74959]:       <nova:flavor name="m1.small">
Nov 28 23:21:01 user nova-compute[74959]:         <nova:memory>2048</nova:memory>
Nov 28 23:21:01 user nova-compute[74959]:         <nova:disk>20</nova:disk>
Nov 28 23:21:01 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:21:01 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:21:01 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:21:01 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:21:01 user nova-compute[74959]:       <nova:owner>
Nov 28 23:21:01 user nova-compute[74959]:         <nova:user uuid="73af90e11a374c9cbf0a58db8410e245">tempest-ServerActionsTestOtherA-2143945835-project-member</nova:user>
Nov 28 23:21:01 user nova-compute[74959]:         <nova:project uuid="0ac0d1f399f040f98098e84ac875c1fd">tempest-ServerActionsTestOtherA-2143945835</nova:project>
Nov 28 23:21:01 user nova-compute[74959]:       </nova:owner>
Nov 28 23:21:01 user nova-compute[74959]:       <nova:ports>
Nov 28 23:21:01 user nova-compute[74959]:         <nova:port uuid="b3bc71e3-1363-4d17-bb0a-89df3579237f">
Nov 28 23:21:01 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 23:21:01 user nova-compute[74959]:         </nova:port>
Nov 28 23:21:01 user nova-compute[74959]:       </nova:ports>
Nov 28 23:21:01 user nova-compute[74959]:     </nova:instance>
Nov 28 23:21:01 user nova-compute[74959]:   </metadata>
Nov 28 23:21:01 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:21:01 user nova-compute[74959]:     <system>
Nov 28 23:21:01 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:21:01 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:21:01 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:21:01 user nova-compute[74959]:       <entry name="serial">6533acac-8b30-4eb5-ba8f-16560e1d5af7</entry>
Nov 28 23:21:01 user nova-compute[74959]:       <entry name="uuid">6533acac-8b30-4eb5-ba8f-16560e1d5af7</entry>
Nov 28 23:21:01 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:21:01 user nova-compute[74959]:     </system>
Nov 28 23:21:01 user nova-compute[74959]:   </sysinfo>
Nov 28 23:21:01 user nova-compute[74959]:   <os>
Nov 28 23:21:01 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:21:01 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:21:01 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:21:01 user nova-compute[74959]:   </os>
Nov 28 23:21:01 user nova-compute[74959]:   <features>
Nov 28 23:21:01 user nova-compute[74959]:     <acpi/>
Nov 28 23:21:01 user nova-compute[74959]:     <apic/>
Nov 28 23:21:01 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:21:01 user nova-compute[74959]:   </features>
Nov 28 23:21:01 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:21:01 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:21:01 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:21:01 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:21:01 user nova-compute[74959]:   </clock>
Nov 28 23:21:01 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:21:01 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:21:01 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:21:01 user nova-compute[74959]:   </cpu>
Nov 28 23:21:01 user nova-compute[74959]:   <devices>
Nov 28 23:21:01 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:21:01 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:21:01 user nova-compute[74959]:       <source dev="/dev/sdd"/>
Nov 28 23:21:01 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:21:01 user nova-compute[74959]:       <serial>d26f5e53-5dd4-4660-94a5-5887fc2f85db</serial>
Nov 28 23:21:01 user nova-compute[74959]:     </disk>
Nov 28 23:21:01 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:21:01 user nova-compute[74959]:       <mac address="fa:16:3e:b9:d3:c0"/>
Nov 28 23:21:01 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:21:01 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:21:01 user nova-compute[74959]:       <target dev="tapb3bc71e3-13"/>
Nov 28 23:21:01 user nova-compute[74959]:     </interface>
Nov 28 23:21:01 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:21:01 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/6533acac-8b30-4eb5-ba8f-16560e1d5af7/console.log" append="off"/>
Nov 28 23:21:01 user nova-compute[74959]:     </serial>
Nov 28 23:21:01 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:21:01 user nova-compute[74959]:     <video>
Nov 28 23:21:01 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:21:01 user nova-compute[74959]:     </video>
Nov 28 23:21:01 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:21:01 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:21:01 user nova-compute[74959]:     </rng>
Nov 28 23:21:01 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:21:01 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:21:01 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:21:01 user nova-compute[74959]:     </memballoon>
Nov 28 23:21:01 user nova-compute[74959]:   </devices>
Nov 28 23:21:01 user nova-compute[74959]: </domain>
Nov 28 23:21:01 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1289172084',display_name='tempest-ServerActionsTestOtherA-server-1289172084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1289172084',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-s1z8orwi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6533acac-8b30-4eb5-ba8f-16560e1d5af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-651875965-network", "vif_mac": "fa:16:3e:b9:d3:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-651875965-network", "vif_mac": "fa:16:3e:b9:d3:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG os_vif [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba170e8e-377b-5d6b-a799-43537bf92577', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3bc71e3-13, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3bc71e3-13, col_values=(('qos', UUID('ce2fa008-1a4c-4b3c-ab95-b66e96250e67')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3bc71e3-13, col_values=(('external_ids', {'iface-id': 'b3bc71e3-1363-4d17-bb0a-89df3579237f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:d3:c0', 'vm-uuid': '6533acac-8b30-4eb5-ba8f-16560e1d5af7'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:01 user nova-compute[74959]: INFO os_vif [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13')
Nov 28 23:21:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:21:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] No VIF found with MAC fa:16:3e:b9:d3:c0, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-2d4c8f2a-2e7e-404d-a3be-b6a93de80e47 req-1b9aebf8-ad78-41a0-88cd-1e258a11662c service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2d4c8f2a-2e7e-404d-a3be-b6a93de80e47 req-1b9aebf8-ad78-41a0-88cd-1e258a11662c service nova] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2d4c8f2a-2e7e-404d-a3be-b6a93de80e47 req-1b9aebf8-ad78-41a0-88cd-1e258a11662c service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2d4c8f2a-2e7e-404d-a3be-b6a93de80e47 req-1b9aebf8-ad78-41a0-88cd-1e258a11662c service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-2d4c8f2a-2e7e-404d-a3be-b6a93de80e47 req-1b9aebf8-ad78-41a0-88cd-1e258a11662c service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] No waiting events found dispatching network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:21:03 user nova-compute[74959]: WARNING nova.compute.manager [req-2d4c8f2a-2e7e-404d-a3be-b6a93de80e47 req-1b9aebf8-ad78-41a0-88cd-1e258a11662c service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received unexpected event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f for instance with vm_state active and task_state resize_finish.
Nov 28 23:21:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-f46ec1e6-642b-4d4a-9b84-83bd07d8d65f req-a104afb2-9a8f-4c37-9ae4-e4b81bf515f7 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f46ec1e6-642b-4d4a-9b84-83bd07d8d65f req-a104afb2-9a8f-4c37-9ae4-e4b81bf515f7 service nova] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f46ec1e6-642b-4d4a-9b84-83bd07d8d65f req-a104afb2-9a8f-4c37-9ae4-e4b81bf515f7 service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-f46ec1e6-642b-4d4a-9b84-83bd07d8d65f req-a104afb2-9a8f-4c37-9ae4-e4b81bf515f7 service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:05 user nova-compute[74959]: DEBUG nova.compute.manager [req-f46ec1e6-642b-4d4a-9b84-83bd07d8d65f req-a104afb2-9a8f-4c37-9ae4-e4b81bf515f7 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] No waiting events found dispatching network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:21:05 user nova-compute[74959]: WARNING nova.compute.manager [req-f46ec1e6-642b-4d4a-9b84-83bd07d8d65f req-a104afb2-9a8f-4c37-9ae4-e4b81bf515f7 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received unexpected event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f for instance with vm_state active and task_state resize_finish.
Nov 28 23:21:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:21:05 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance running successfully.
Nov 28 23:21:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Failed to set time: agent not configured {{(pid=74959) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 23:21:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9811ee05-afd3-4c01-b26c-1f6e5299d1f5 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] finish_migration finished successfully. {{(pid=74959) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 23:21:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:11 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15eae952-f2b9-4762-8daf-ef551b24931d is timed out.
Nov 28 23:21:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully detached device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the live domain config.
Nov 28 23:21:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSmZcLag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:21:11 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a782bbbe-525a-4408-9210-187c2f9af444]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:21:11 user nova-compute[74959]: No targets found.
Nov 28 23:21:11 user nova-compute[74959]: iSNS:
Nov 28 23:21:11 user nova-compute[74959]: No targets found.
Nov 28 23:21:11 user nova-compute[74959]: STATIC:
Nov 28 23:21:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898
Nov 28 23:21:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:21:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:21:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473
Nov 28 23:21:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:21:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:21:11 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:21:11 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:21:11 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:21:11 user nova-compute[74959]: FIRMWARE:
Nov 28 23:21:11 user nova-compute[74959]: No targets found.
Nov 28 23:21:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:21:11 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:21:11 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cda985-af4f-4a47-8b64-1aca6de57fd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb488b6a-0264-4692-94ac-8720890c24aa]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:21:11 user nova-compute[74959]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:21:11 user nova-compute[74959]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 (non-flash)
Nov 28 23:21:11 user nova-compute[74959]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:21:11 user nova-compute[74959]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef78d9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898'): ({'sdc'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Removing single pathed devices sdc {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[09714592-56da-4f6a-84fc-329f82ef8b1d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ee77b2-c9e8-4a83-8c8b-4c74d84397b4]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Flushing IO for device /dev/sdc {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecc97ea-e091-4231-96dd-020781b474d4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6bc854-10a5-4e13-a358-1bc63ed55609]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d924b0-1b13-49e8-895b-3faf6ab4cf26]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9000eda5-fa6c-40d1-9c74-8591be2ca46a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898, portal: 172.16.0.220,3260]
Nov 28 23:21:11 user nova-compute[74959]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898, portal: 172.16.0.220,3260] successful.
Nov 28 23:21:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb3dd66f-4bc6-421b-8b0c-d9695a266898 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e09f1c-5a7c-449a-be83-f75c87ddde10]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== disconnect_volume: return (451ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:21:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:12 user nova-compute[74959]: DEBUG nova.objects.instance [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:21:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-855efbca-3e2c-47c6-bffb-cd8f02e5ebb7 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.951s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:13 user nova-compute[74959]: INFO nova.compute.manager [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Detaching volume 77a4d651-dbd9-4750-833a-91f1e9240473
Nov 28 23:21:13 user nova-compute[74959]: INFO nova.virt.block_device [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Attempting to driver detach volume 77a4d651-dbd9-4750-833a-91f1e9240473 from mountpoint /dev/vdb
Nov 28 23:21:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Attempting to detach device vdb from instance 7bce9741-61f6-4141-be40-e779d536fa0a from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:21:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:21:13 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:21:13 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:21:13 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:21:13 user nova-compute[74959]:   <serial>77a4d651-dbd9-4750-833a-91f1e9240473</serial>
Nov 28 23:21:13 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:21:13 user nova-compute[74959]: </disk>
Nov 28 23:21:13 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:21:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Successfully detached device vdb from instance 7bce9741-61f6-4141-be40-e779d536fa0a from the persistent domain config.
Nov 28 23:21:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7bce9741-61f6-4141-be40-e779d536fa0a from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:21:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:21:13 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:21:13 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:21:13 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:21:13 user nova-compute[74959]:   <serial>77a4d651-dbd9-4750-833a-91f1e9240473</serial>
Nov 28 23:21:13 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:21:13 user nova-compute[74959]: </disk>
Nov 28 23:21:13 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:21:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7bce9741-61f6-4141-be40-e779d536fa0a {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:21:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:21:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:21:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:21:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:22 user nova-compute[74959]: INFO nova.compute.manager [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Terminating instance
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-145ec176-16d0-4c22-93aa-05a168b11d6e req-5f789da6-c4d5-403a-a89d-b49c0235a578 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-145ec176-16d0-4c22-93aa-05a168b11d6e req-5f789da6-c4d5-403a-a89d-b49c0235a578 service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-145ec176-16d0-4c22-93aa-05a168b11d6e req-5f789da6-c4d5-403a-a89d-b49c0235a578 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-145ec176-16d0-4c22-93aa-05a168b11d6e req-5f789da6-c4d5-403a-a89d-b49c0235a578 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-145ec176-16d0-4c22-93aa-05a168b11d6e req-5f789da6-c4d5-403a-a89d-b49c0235a578 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-145ec176-16d0-4c22-93aa-05a168b11d6e req-5f789da6-c4d5-403a-a89d-b49c0235a578 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-unplugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:21:22 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Instance destroyed successfully.
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.objects.instance [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lazy-loading 'resources' on Instance uuid 5d351a14-fe3f-4c98-833c-cdff15e5831b {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1764014992',display_name='tempest-ServerRescueNegativeTestJSON-server-1764014992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1764014992',id=18,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:09:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69f1c42c1314a41ac6a4ae41fb64c7c',ramdisk_id='',reservation_id='r-oh9l1yxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1452838145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1452838145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:10:53Z,user_data=None,user_id='a59fecc5b484491ca4f6b326d8bfcb67',uuid=5d351a14-fe3f-4c98-833c-cdff15e5831b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converting VIF {"id": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "address": "fa:16:3e:a7:5f:d1", "network": {"id": "d8d37920-8ca7-4c88-8478-d6f6acaa4647", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-123092982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69f1c42c1314a41ac6a4ae41fb64c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea3d331-73", "ovs_interfaceid": "0ea3d331-73b7-4329-8f0a-83513c3c6b24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:5f:d1,bridge_name='br-int',has_traffic_filtering=True,id=0ea3d331-73b7-4329-8f0a-83513c3c6b24,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3d331-73') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG os_vif [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:5f:d1,bridge_name='br-int',has_traffic_filtering=True,id=0ea3d331-73b7-4329-8f0a-83513c3c6b24,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3d331-73') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ea3d331-73, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=089561a0-6a01-4925-8831-648855834794) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:22 user nova-compute[74959]: INFO os_vif [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:5f:d1,bridge_name='br-int',has_traffic_filtering=True,id=0ea3d331-73b7-4329-8f0a-83513c3c6b24,network=Network(d8d37920-8ca7-4c88-8478-d6f6acaa4647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea3d331-73')
Nov 28 23:21:22 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Deleting instance files /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b_del
Nov 28 23:21:22 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Deletion of /opt/stack/data/nova/instances/5d351a14-fe3f-4c98-833c-cdff15e5831b_del complete
Nov 28 23:21:22 user nova-compute[74959]: INFO nova.compute.manager [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 28 23:21:22 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:21:22 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:21:23 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:21:23 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Took 0.61 seconds to deallocate network for instance.
Nov 28 23:21:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-cbc1e949-1a4c-4b6a-8ee7-afd7a63017ed req-27def044-b41c-41a6-86d1-dd817146b427 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-deleted-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:23 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:21:23 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:21:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:23 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Deleted allocations for instance 5d351a14-fe3f-4c98-833c-cdff15e5831b
Nov 28 23:21:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-59c8e45d-0a03-4cf8-a82d-0d9fc978a28b tempest-ServerRescueNegativeTestJSON-1452838145 tempest-ServerRescueNegativeTestJSON-1452838145-project-member] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-4769feb9-8e42-436b-815b-f3be201d482c req-58238bea-a1cf-4fc8-9449-5c970f7e8e66 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4769feb9-8e42-436b-815b-f3be201d482c req-58238bea-a1cf-4fc8-9449-5c970f7e8e66 service nova] Acquiring lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4769feb9-8e42-436b-815b-f3be201d482c req-58238bea-a1cf-4fc8-9449-5c970f7e8e66 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4769feb9-8e42-436b-815b-f3be201d482c req-58238bea-a1cf-4fc8-9449-5c970f7e8e66 service nova] Lock "5d351a14-fe3f-4c98-833c-cdff15e5831b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-4769feb9-8e42-436b-815b-f3be201d482c req-58238bea-a1cf-4fc8-9449-5c970f7e8e66 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] No waiting events found dispatching network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:21:24 user nova-compute[74959]: WARNING nova.compute.manager [req-4769feb9-8e42-436b-815b-f3be201d482c req-58238bea-a1cf-4fc8-9449-5c970f7e8e66 service nova] [instance: 5d351a14-fe3f-4c98-833c-cdff15e5831b] Received unexpected event network-vif-plugged-0ea3d331-73b7-4329-8f0a-83513c3c6b24 for instance with vm_state deleted and task_state None.
Nov 28 23:21:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "32ab8acf-d827-4043-8435-43d702bd8ea7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:33 user nova-compute[74959]: INFO nova.compute.manager [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Terminating instance
Nov 28 23:21:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.compute.manager [req-21c98d2e-60fa-4e60-a38b-29f6487ffd82 req-36b9b94a-0dc7-4201-88a7-08cb47ec84e5 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received event network-vif-unplugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21c98d2e-60fa-4e60-a38b-29f6487ffd82 req-36b9b94a-0dc7-4201-88a7-08cb47ec84e5 service nova] Acquiring lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21c98d2e-60fa-4e60-a38b-29f6487ffd82 req-36b9b94a-0dc7-4201-88a7-08cb47ec84e5 service nova] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-21c98d2e-60fa-4e60-a38b-29f6487ffd82 req-36b9b94a-0dc7-4201-88a7-08cb47ec84e5 service nova] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.compute.manager [req-21c98d2e-60fa-4e60-a38b-29f6487ffd82 req-36b9b94a-0dc7-4201-88a7-08cb47ec84e5 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] No waiting events found dispatching network-vif-unplugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.compute.manager [req-21c98d2e-60fa-4e60-a38b-29f6487ffd82 req-36b9b94a-0dc7-4201-88a7-08cb47ec84e5 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received event network-vif-unplugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:21:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7bce9741-61f6-4141-be40-e779d536fa0a is timed out.
Nov 28 23:21:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Successfully detached device vdb from instance 7bce9741-61f6-4141-be40-e779d536fa0a from the live domain config.
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsORMuJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:21:34 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:21:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Instance destroyed successfully.
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.objects.instance [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lazy-loading 'resources' on Instance uuid 32ab8acf-d827-4043-8435-43d702bd8ea7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-463417566',display_name='tempest-VolumesActionsTest-instance-463417566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-463417566',id=41,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:19:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='970869d439544caa9fbc57b53c962c23',ramdisk_id='',reservation_id='r-3q8iymqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-209175437',owner_user_name='tempest-VolumesActionsTest-209175437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:19:49Z,user_data=None,user_id='22870bdb55a94a2c938fa2f4b663f09d',uuid=32ab8acf-d827-4043-8435-43d702bd8ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converting VIF {"id": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "address": "fa:16:3e:26:0c:2c", "network": {"id": "cedbe825-cf14-4a54-a822-3d2e0e7de14f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1995306553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "970869d439544caa9fbc57b53c962c23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb6ab30-8a", "ovs_interfaceid": "adb6ab30-8ab7-43e9-9c35-a8261d297412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:0c:2c,bridge_name='br-int',has_traffic_filtering=True,id=adb6ab30-8ab7-43e9-9c35-a8261d297412,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6ab30-8a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_vif [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:0c:2c,bridge_name='br-int',has_traffic_filtering=True,id=adb6ab30-8ab7-43e9-9c35-a8261d297412,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6ab30-8a') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadb6ab30-8a, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f46be7c-50cb-4b5a-9b28-7110401270b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:21:34 user nova-compute[74959]: No targets found.
Nov 28 23:21:34 user nova-compute[74959]: iSNS:
Nov 28 23:21:34 user nova-compute[74959]: No targets found.
Nov 28 23:21:34 user nova-compute[74959]: STATIC:
Nov 28 23:21:34 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473
Nov 28 23:21:34 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:21:34 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:21:34 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:21:34 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:21:34 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:21:34 user nova-compute[74959]: FIRMWARE:
Nov 28 23:21:34 user nova-compute[74959]: No targets found.
Nov 28 23:21:34 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:21:34 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:21:34 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba0b1ca0-adb7-4d57-983b-8eda55d1361f) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:34 user nova-compute[74959]: INFO os_vif [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:0c:2c,bridge_name='br-int',has_traffic_filtering=True,id=adb6ab30-8ab7-43e9-9c35-a8261d297412,network=Network(cedbe825-cf14-4a54-a822-3d2e0e7de14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb6ab30-8a')
Nov 28 23:21:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Deleting instance files /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7_del
Nov 28 23:21:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Deletion of /opt/stack/data/nova/instances/32ab8acf-d827-4043-8435-43d702bd8ea7_del complete
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9441d8-c8a1-4cc0-832c-0f27cb4a0d8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ee71b-cfb2-4586-868b-9c17772dab8f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:21:34 user nova-compute[74959]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:34 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 (non-flash)
Nov 28 23:21:34 user nova-compute[74959]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:34 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc5be440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2e8646-41cc-459a-8cf4-a4c5d0c82722]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: INFO nova.compute.manager [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9345e18e-1089-4760-8197-bc06e1261d32]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3513b2-0627-4d23-948c-db2dc916cad6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[131fcf4f-d39f-466d-9483-46a5234ccf80]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b016419a-4b7d-4742-808e-1f0de4011c18]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[443af5b4-8bed-42d1-9210-c438752e6995]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473, portal: 172.16.0.220,3260]
Nov 28 23:21:34 user nova-compute[74959]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473, portal: 172.16.0.220,3260] successful.
Nov 28 23:21:34 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41ded65-b8bf-4575-a53d-a619fe4e294f]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] <== disconnect_volume: return (318ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:34 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:21:35 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Took 0.56 seconds to deallocate network for instance.
Nov 28 23:21:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-edee65d9-9a79-4c5e-9bd3-bbadc1375d7b req-6043c751-ea43-4990-8379-22bde0163fe8 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received event network-vif-deleted-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:35 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Deleted allocations for instance 32ab8acf-d827-4043-8435-43d702bd8ea7
Nov 28 23:21:35 user nova-compute[74959]: DEBUG nova.objects.instance [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'flavor' on Instance uuid 7bce9741-61f6-4141-be40-e779d536fa0a {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-91598a88-f9df-4a30-a33f-e5f981720c4f tempest-VolumesActionsTest-209175437 tempest-VolumesActionsTest-209175437-project-member] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.924s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-379fda69-84bf-4d2e-92ed-5c7142923eb3 tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.075s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.963s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:35 user nova-compute[74959]: INFO nova.compute.manager [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Terminating instance
Nov 28 23:21:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-51b8adbc-0a7c-4cbe-a815-44433d81beda req-d9510023-ebad-455c-958b-63cf456338c8 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received event network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-51b8adbc-0a7c-4cbe-a815-44433d81beda req-d9510023-ebad-455c-958b-63cf456338c8 service nova] Acquiring lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-51b8adbc-0a7c-4cbe-a815-44433d81beda req-d9510023-ebad-455c-958b-63cf456338c8 service nova] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-51b8adbc-0a7c-4cbe-a815-44433d81beda req-d9510023-ebad-455c-958b-63cf456338c8 service nova] Lock "32ab8acf-d827-4043-8435-43d702bd8ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-51b8adbc-0a7c-4cbe-a815-44433d81beda req-d9510023-ebad-455c-958b-63cf456338c8 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] No waiting events found dispatching network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:21:35 user nova-compute[74959]: WARNING nova.compute.manager [req-51b8adbc-0a7c-4cbe-a815-44433d81beda req-d9510023-ebad-455c-958b-63cf456338c8 service nova] [instance: 32ab8acf-d827-4043-8435-43d702bd8ea7] Received unexpected event network-vif-plugged-adb6ab30-8ab7-43e9-9c35-a8261d297412 for instance with vm_state deleted and task_state None.
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Instance destroyed successfully.
Nov 28 23:21:36 user nova-compute[74959]: DEBUG nova.objects.instance [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lazy-loading 'resources' on Instance uuid 7bce9741-61f6-4141-be40-e779d536fa0a {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2030406951',display_name='tempest-VolumesSnapshotTestJSON-instance-2030406951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2030406951',id=39,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrglRm+FKzUxkzaSf480FPz4SnvvElDuG2L2kF3HbsVXESBainN+4Q4gBPzfBpHv9r36TeovWSz4kLGWKBE73oJd+oRQMH0R98s2UW40uLuKJfnjUKXIwerb84qBgDXLw==',key_name='tempest-keypair-1170964908',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:19:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4e44315cc7e42f3ac72740bfba170e4',ramdisk_id='',reservation_id='r-ix6tm5p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1119708422',owner_user_name='tempest-VolumesSnapshotTestJSON-1119708422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18a99b86ac9844fd8ad2329e41d22c65',uuid=7bce9741-61f6-4141-be40-e779d536fa0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converting VIF {"id": "6d5f273c-1220-4e91-9659-59b5178d669a", "address": "fa:16:3e:7f:fc:c7", "network": {"id": "11067dda-510c-4a97-ac76-919433825411", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-113821619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e44315cc7e42f3ac72740bfba170e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d5f273c-12", "ovs_interfaceid": "6d5f273c-1220-4e91-9659-59b5178d669a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=6d5f273c-1220-4e91-9659-59b5178d669a,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5f273c-12') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_vif [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=6d5f273c-1220-4e91-9659-59b5178d669a,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5f273c-12') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d5f273c-12, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c7d82e0-04ca-47ec-98cd-bac82f59a6e0) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:36 user nova-compute[74959]: INFO os_vif [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:fc:c7,bridge_name='br-int',has_traffic_filtering=True,id=6d5f273c-1220-4e91-9659-59b5178d669a,network=Network(11067dda-510c-4a97-ac76-919433825411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d5f273c-12')
Nov 28 23:21:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsORMuJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:21:36 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e4b4a-260b-46b0-8735-e57f3f9d2eac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:21:36 user nova-compute[74959]: No targets found.
Nov 28 23:21:36 user nova-compute[74959]: iSNS:
Nov 28 23:21:36 user nova-compute[74959]: No targets found.
Nov 28 23:21:36 user nova-compute[74959]: STATIC:
Nov 28 23:21:36 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:21:36 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:21:36 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:21:36 user nova-compute[74959]: FIRMWARE:
Nov 28 23:21:36 user nova-compute[74959]: No targets found.
Nov 28 23:21:36 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:21:36 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:21:36 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a4d651-dbd9-4750-833a-91f1e9240473', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8303c446-da3f-43da-9c00-14413e14bd69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb279263-0fcc-4ada-910f-20fa8c9c97f3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:36 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:36 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec36f880>, {}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Disconnecting from: [] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] <== disconnect_volume: return (75ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:21:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Deleting instance files /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a_del
Nov 28 23:21:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Deletion of /opt/stack/data/nova/instances/7bce9741-61f6-4141-be40-e779d536fa0a_del complete
Nov 28 23:21:36 user nova-compute[74959]: INFO nova.compute.manager [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 28 23:21:36 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:21:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received event network-vif-unplugged-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] No waiting events found dispatching network-vif-unplugged-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received event network-vif-unplugged-6d5f273c-1220-4e91-9659-59b5178d669a for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received event network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] Acquiring lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] Lock "7bce9741-61f6-4141-be40-e779d536fa0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] No waiting events found dispatching network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:21:37 user nova-compute[74959]: WARNING nova.compute.manager [req-eeb962bf-c0a1-43be-9283-726a812a0bba req-7f80b78d-96a1-44d3-b5ce-a93671f5c0d5 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received unexpected event network-vif-plugged-6d5f273c-1220-4e91-9659-59b5178d669a for instance with vm_state active and task_state deleting.
Nov 28 23:21:37 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:21:37 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Took 0.90 seconds to deallocate network for instance.
Nov 28 23:21:37 user nova-compute[74959]: WARNING nova.volume.cinder [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Attachment eb2b34cb-dd9c-413b-b114-3c34ff6267d4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = eb2b34cb-dd9c-413b-b114-3c34ff6267d4. (HTTP 404) (Request-ID: req-604386c7-ea8d-48d9-984c-85078c9c4eb0)
Nov 28 23:21:37 user nova-compute[74959]: INFO nova.compute.manager [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Took 0.02 seconds to detach 1 volumes for instance.
Nov 28 23:21:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:21:37 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:21:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:38 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Deleted allocations for instance 7bce9741-61f6-4141-be40-e779d536fa0a
Nov 28 23:21:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1c994e5b-97b1-4ac8-acf6-e1498678a77b tempest-VolumesSnapshotTestJSON-1119708422 tempest-VolumesSnapshotTestJSON-1119708422-project-member] Lock "7bce9741-61f6-4141-be40-e779d536fa0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.695s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-f0363804-c605-4880-8f79-1f484a04c46d req-3760a705-5731-4124-ad0d-46dd9d748ed6 service nova] [instance: 7bce9741-61f6-4141-be40-e779d536fa0a] Received event network-vif-deleted-6d5f273c-1220-4e91-9659-59b5178d669a {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:21:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:43 user nova-compute[74959]: DEBUG nova.objects.instance [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:21:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:44 user nova-compute[74959]: INFO nova.compute.manager [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attaching volume f849dca3-ca81-4173-8997-92a908a03025 to /dev/vdb
Nov 28 23:21:44 user nova-compute[74959]: DEBUG os_brick.utils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ea0b7f-ea58-41be-9ba9-cba1e4f23249]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[75488f42-406a-438f-81bb-ba90b88fa487]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9e81bd-7f54-4839-ac66-afd5c292206d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d786896c-1d0d-4c55-8193-a0d9d8860b5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:21:44 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:21:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[272f6eff-343e-4119-87aa-509d22cb9ff0]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG os_brick.utils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:21:44 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating existing volume attachment record: c63f9dec-3432-4b2b-89ae-7c6752f56e0c {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:21:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcCYhoEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:21:51 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:21:51 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:21:51 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9847ddbd-6f8f-4ab3-8448-58ba7030dd30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:21:51 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81c124e-5351-42dc-bc6d-5850fe925070]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025] added
Nov 28 23:21:51 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4626a5-94a4-487c-8b15-d1140e3b79d3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cafecd-98af-47a3-9a9d-8098850f7586]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcCYhoEb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcCYhoEb" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6202f278-4b20-4636-ac97-587baf4ec5a9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcCYhoEb'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2065399-e469-49f0-8b6f-6590842d450b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf143bfe-53dd-45c1-9143-6540897f206d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:51 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:51 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e0a406-8e55-4517-a353-84cb56f10971]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025, portal: 172.16.0.220,3260]
Nov 28 23:21:51 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025, portal: 172.16.0.220,3260] successful.
Nov 28 23:21:51 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3663d02-da19-49d2-969e-4eac853dd739]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de87dba-93de-41c1-bdfb-adf40606c536]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:51 user nova-compute[74959]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 (non-flash)
Nov 28 23:21:51 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:21:51 user nova-compute[74959]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 (non-flash)
Nov 28 23:21:51 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d91923-10fe-4deb-a551-b832ea96e582]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcCYhoEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:21:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23663393933326263', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663393933326263', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG nova.objects.instance [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:21:52 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:21:52 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:21:52 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:21:52 user nova-compute[74959]:   <serial>f849dca3-ca81-4173-8997-92a908a03025</serial>
Nov 28 23:21:52 user nova-compute[74959]: </disk>
Nov 28 23:21:52 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:21:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No VIF found with MAC fa:16:3e:49:71:8b, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:21:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-098423b0-b0be-493b-8cba-b72365d3539a tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.006s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updating instance_info_cache with network_info: [{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:21:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:21:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:21:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:55 user nova-compute[74959]: INFO nova.compute.manager [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Detaching volume f849dca3-ca81-4173-8997-92a908a03025
Nov 28 23:21:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:21:55 user nova-compute[74959]: INFO nova.virt.block_device [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attempting to driver detach volume f849dca3-ca81-4173-8997-92a908a03025 from mountpoint /dev/vdb
Nov 28 23:21:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Attempting to detach device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:21:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:21:55 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:21:55 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:21:55 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:21:55 user nova-compute[74959]:   <serial>f849dca3-ca81-4173-8997-92a908a03025</serial>
Nov 28 23:21:55 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:21:55 user nova-compute[74959]: </disk>
Nov 28 23:21:55 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:21:55 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully detached device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the persistent domain config.
Nov 28 23:21:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:21:55 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:21:55 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:21:55 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:21:55 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:21:55 user nova-compute[74959]:   <serial>f849dca3-ca81-4173-8997-92a908a03025</serial>
Nov 28 23:21:55 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:21:55 user nova-compute[74959]: </disk>
Nov 28 23:21:55 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:21:56 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:21:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:57 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:21:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:21:58 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8490MB free_disk=25.20201873779297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Applying migration context for instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 as it has an incoming, in-progress migration a73d6c44-7730-4d98-9676-567d8df31291. Migration status is finished {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 23:21:58 user nova-compute[74959]: INFO nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating resource usage from migration a73d6c44-7730-4d98-9676-567d8df31291
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 15eae952-f2b9-4762-8daf-ef551b24931d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Migration a73d6c44-7730-4d98-9676-567d8df31291 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:21:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:21:59 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:21:59 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:21:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:21:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:21:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:22:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:22:11 user nova-compute[74959]: INFO nova.compute.claims [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Claim successful on node user
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:22:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.policy [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76f0678a37a54084a10ef59450bf48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc33683ac964b16b2e8115112f7489b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:22:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Creating image(s)
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "/opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "/opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "/opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk 1073741824" returned: 0 in 0.054s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.201s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Successfully created port: 2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Cannot resize image /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Ensure instance console log exists: /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Successfully updated port: 2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquired lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-5790f33f-6883-4366-b0f1-ce4c5b92d6e7 req-af507f11-7ad8-44c7-9093-48244553e1a3 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-changed-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-5790f33f-6883-4366-b0f1-ce4c5b92d6e7 req-af507f11-7ad8-44c7-9093-48244553e1a3 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Refreshing instance network info cache due to event network-changed-2c30f0a4-c515-41ca-8221-127697ead54c. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5790f33f-6883-4366-b0f1-ce4c5b92d6e7 req-af507f11-7ad8-44c7-9093-48244553e1a3 service nova] Acquiring lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating instance_info_cache with network_info: [{"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Releasing lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Instance network_info: |[{"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5790f33f-6883-4366-b0f1-ce4c5b92d6e7 req-af507f11-7ad8-44c7-9093-48244553e1a3 service nova] Acquired lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-5790f33f-6883-4366-b0f1-ce4c5b92d6e7 req-af507f11-7ad8-44c7-9093-48244553e1a3 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Refreshing network info cache for port 2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Start _get_guest_xml network_info=[{"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:22:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:22:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-261642393',display_name='tempest-TestStampPattern-server-261642393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-261642393',id=42,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4cOJf3ly2NvcASqmkADfhxKCfflwBu5oBowaFWrr/ngo6IFGpG8y1JHOAFnUs10K+hlInoVkZOf7OKgfcb+GDy0CADTfxxg4vsu+43PCPS+aote/8Pp0lrXLBlefKGNA==',key_name='tempest-TestStampPattern-807671422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc33683ac964b16b2e8115112f7489b',ramdisk_id='',reservation_id='r-onkicu8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1559655051',owner_user_name='tempest-TestStampPattern-1559655051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:22:12Z,user_data=None,user_id='76f0678a37a54084a10ef59450bf48ae',uuid=1effa435-b29a-424b-938a-2d5a2bb61853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converting VIF {"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:b2:b6,bridge_name='br-int',has_traffic_filtering=True,id=2c30f0a4-c515-41ca-8221-127697ead54c,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c30f0a4-c5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'pci_devices' on Instance uuid 1effa435-b29a-424b-938a-2d5a2bb61853 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:22:13 user nova-compute[74959]:   <uuid>1effa435-b29a-424b-938a-2d5a2bb61853</uuid>
Nov 28 23:22:13 user nova-compute[74959]:   <name>instance-0000002a</name>
Nov 28 23:22:13 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:22:13 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:22:13 user nova-compute[74959]:   <metadata>
Nov 28 23:22:13 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:22:13 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:22:13 user nova-compute[74959]:       <nova:name>tempest-TestStampPattern-server-261642393</nova:name>
Nov 28 23:22:13 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:22:13</nova:creationTime>
Nov 28 23:22:13 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:22:13 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:22:13 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:22:13 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:22:13 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:22:13 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:22:13 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:22:13 user nova-compute[74959]:       <nova:owner>
Nov 28 23:22:13 user nova-compute[74959]:         <nova:user uuid="76f0678a37a54084a10ef59450bf48ae">tempest-TestStampPattern-1559655051-project-member</nova:user>
Nov 28 23:22:13 user nova-compute[74959]:         <nova:project uuid="fcc33683ac964b16b2e8115112f7489b">tempest-TestStampPattern-1559655051</nova:project>
Nov 28 23:22:13 user nova-compute[74959]:       </nova:owner>
Nov 28 23:22:13 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:22:13 user nova-compute[74959]:       <nova:ports>
Nov 28 23:22:13 user nova-compute[74959]:         <nova:port uuid="2c30f0a4-c515-41ca-8221-127697ead54c">
Nov 28 23:22:13 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:22:13 user nova-compute[74959]:         </nova:port>
Nov 28 23:22:13 user nova-compute[74959]:       </nova:ports>
Nov 28 23:22:13 user nova-compute[74959]:     </nova:instance>
Nov 28 23:22:13 user nova-compute[74959]:   </metadata>
Nov 28 23:22:13 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:22:13 user nova-compute[74959]:     <system>
Nov 28 23:22:13 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:22:13 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:22:13 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:22:13 user nova-compute[74959]:       <entry name="serial">1effa435-b29a-424b-938a-2d5a2bb61853</entry>
Nov 28 23:22:13 user nova-compute[74959]:       <entry name="uuid">1effa435-b29a-424b-938a-2d5a2bb61853</entry>
Nov 28 23:22:13 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:22:13 user nova-compute[74959]:     </system>
Nov 28 23:22:13 user nova-compute[74959]:   </sysinfo>
Nov 28 23:22:13 user nova-compute[74959]:   <os>
Nov 28 23:22:13 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:22:13 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:22:13 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:22:13 user nova-compute[74959]:   </os>
Nov 28 23:22:13 user nova-compute[74959]:   <features>
Nov 28 23:22:13 user nova-compute[74959]:     <acpi/>
Nov 28 23:22:13 user nova-compute[74959]:     <apic/>
Nov 28 23:22:13 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:22:13 user nova-compute[74959]:   </features>
Nov 28 23:22:13 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:22:13 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:22:13 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:22:13 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:22:13 user nova-compute[74959]:   </clock>
Nov 28 23:22:13 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:22:13 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:22:13 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:22:13 user nova-compute[74959]:   </cpu>
Nov 28 23:22:13 user nova-compute[74959]:   <devices>
Nov 28 23:22:13 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:22:13 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:22:13 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk"/>
Nov 28 23:22:13 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:22:13 user nova-compute[74959]:     </disk>
Nov 28 23:22:13 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:22:13 user nova-compute[74959]:       <mac address="fa:16:3e:66:b2:b6"/>
Nov 28 23:22:13 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:22:13 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:22:13 user nova-compute[74959]:       <target dev="tap2c30f0a4-c5"/>
Nov 28 23:22:13 user nova-compute[74959]:     </interface>
Nov 28 23:22:13 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:22:13 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/console.log" append="off"/>
Nov 28 23:22:13 user nova-compute[74959]:     </serial>
Nov 28 23:22:13 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:22:13 user nova-compute[74959]:     <video>
Nov 28 23:22:13 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:22:13 user nova-compute[74959]:     </video>
Nov 28 23:22:13 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:22:13 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:22:13 user nova-compute[74959]:     </rng>
Nov 28 23:22:13 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:22:13 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:22:13 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:22:13 user nova-compute[74959]:     </memballoon>
Nov 28 23:22:13 user nova-compute[74959]:   </devices>
Nov 28 23:22:13 user nova-compute[74959]: </domain>
Nov 28 23:22:13 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-261642393',display_name='tempest-TestStampPattern-server-261642393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-261642393',id=42,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4cOJf3ly2NvcASqmkADfhxKCfflwBu5oBowaFWrr/ngo6IFGpG8y1JHOAFnUs10K+hlInoVkZOf7OKgfcb+GDy0CADTfxxg4vsu+43PCPS+aote/8Pp0lrXLBlefKGNA==',key_name='tempest-TestStampPattern-807671422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc33683ac964b16b2e8115112f7489b',ramdisk_id='',reservation_id='r-onkicu8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1559655051',owner_user_name='tempest-TestStampPattern-1559655051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:22:12Z,user_data=None,user_id='76f0678a37a54084a10ef59450bf48ae',uuid=1effa435-b29a-424b-938a-2d5a2bb61853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converting VIF {"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:b2:b6,bridge_name='br-int',has_traffic_filtering=True,id=2c30f0a4-c515-41ca-8221-127697ead54c,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c30f0a4-c5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG os_vif [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:b2:b6,bridge_name='br-int',has_traffic_filtering=True,id=2c30f0a4-c515-41ca-8221-127697ead54c,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c30f0a4-c5') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11cfc208-2025-55a9-968a-317763698ba1', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c30f0a4-c5, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c30f0a4-c5, col_values=(('qos', UUID('cfb41251-819c-4f78-831d-0c3b6d17cc82')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c30f0a4-c5, col_values=(('external_ids', {'iface-id': '2c30f0a4-c515-41ca-8221-127697ead54c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:b2:b6', 'vm-uuid': '1effa435-b29a-424b-938a-2d5a2bb61853'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:13 user nova-compute[74959]: INFO os_vif [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:b2:b6,bridge_name='br-int',has_traffic_filtering=True,id=2c30f0a4-c515-41ca-8221-127697ead54c,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c30f0a4-c5')
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No VIF found with MAC fa:16:3e:66:b2:b6, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-5790f33f-6883-4366-b0f1-ce4c5b92d6e7 req-af507f11-7ad8-44c7-9093-48244553e1a3 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updated VIF entry in instance network info cache for port 2c30f0a4-c515-41ca-8221-127697ead54c. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-5790f33f-6883-4366-b0f1-ce4c5b92d6e7 req-af507f11-7ad8-44c7-9093-48244553e1a3 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating instance_info_cache with network_info: [{"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:22:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5790f33f-6883-4366-b0f1-ce4c5b92d6e7 req-af507f11-7ad8-44c7-9093-48244553e1a3 service nova] Releasing lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:22:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-bfa7ec1e-7799-4fdc-902c-7fbdc6880254 req-ab19b111-ef6f-4c7a-93d5-3f7c4a6c1f6e service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:22:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bfa7ec1e-7799-4fdc-902c-7fbdc6880254 req-ab19b111-ef6f-4c7a-93d5-3f7c4a6c1f6e service nova] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bfa7ec1e-7799-4fdc-902c-7fbdc6880254 req-ab19b111-ef6f-4c7a-93d5-3f7c4a6c1f6e service nova] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-bfa7ec1e-7799-4fdc-902c-7fbdc6880254 req-ab19b111-ef6f-4c7a-93d5-3f7c4a6c1f6e service nova] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:15 user nova-compute[74959]: DEBUG nova.compute.manager [req-bfa7ec1e-7799-4fdc-902c-7fbdc6880254 req-ab19b111-ef6f-4c7a-93d5-3f7c4a6c1f6e service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] No waiting events found dispatching network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:22:15 user nova-compute[74959]: WARNING nova.compute.manager [req-bfa7ec1e-7799-4fdc-902c-7fbdc6880254 req-ab19b111-ef6f-4c7a-93d5-3f7c4a6c1f6e service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received unexpected event network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c for instance with vm_state building and task_state spawning.
Nov 28 23:22:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:16 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15eae952-f2b9-4762-8daf-ef551b24931d is timed out.
Nov 28 23:22:16 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully detached device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the live domain config.
Nov 28 23:22:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcCYhoEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:22:16 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc93df0b-632c-46e8-b819-cd0bf350f11c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:22:16 user nova-compute[74959]: No targets found.
Nov 28 23:22:16 user nova-compute[74959]: iSNS:
Nov 28 23:22:16 user nova-compute[74959]: No targets found.
Nov 28 23:22:16 user nova-compute[74959]: STATIC:
Nov 28 23:22:16 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:22:16 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:22:16 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:22:16 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025
Nov 28 23:22:16 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:22:16 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:22:16 user nova-compute[74959]: FIRMWARE:
Nov 28 23:22:16 user nova-compute[74959]: No targets found.
Nov 28 23:22:16 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:22:16 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:22:16 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d333e5-02de-4276-9168-76284b23c85d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce193986-7a53-49c4-a905-8da13db15b48]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:22:16 user nova-compute[74959]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 (non-flash)
Nov 28 23:22:16 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:22:16 user nova-compute[74959]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 (non-flash)
Nov 28 23:22:16 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef41370a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59a200c-9e47-4018-8568-6e550ad9a768]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c153c0-5dae-4e1c-b3f2-72cff6b0726e]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6619f3-a021-4ebe-a23f-a91be2a96881]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[27225c94-9873-4cd5-89a2-9e490be26baf]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abf8fb0-3381-4266-bbfa-98f82055f615]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f836c98-4dfe-4b7b-8e83-2502126e38d7]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025, portal: 172.16.0.220,3260]
Nov 28 23:22:16 user nova-compute[74959]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025, portal: 172.16.0.220,3260] successful.
Nov 28 23:22:16 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f849dca3-ca81-4173-8997-92a908a03025 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6918de-05ef-4e00-bacf-0cbb72935800]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== disconnect_volume: return (318ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:22:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:22:17 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Instance spawned successfully.
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.objects.instance [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-02867362-1d25-4278-b2a0-d478b858bd17 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-de523f7d-fd86-487b-988d-7f23c60ad183 req-18c34d4d-bedd-473f-9f4f-10840d94e673 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-de523f7d-fd86-487b-988d-7f23c60ad183 req-18c34d4d-bedd-473f-9f4f-10840d94e673 service nova] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-de523f7d-fd86-487b-988d-7f23c60ad183 req-18c34d4d-bedd-473f-9f4f-10840d94e673 service nova] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-de523f7d-fd86-487b-988d-7f23c60ad183 req-18c34d4d-bedd-473f-9f4f-10840d94e673 service nova] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.compute.manager [req-de523f7d-fd86-487b-988d-7f23c60ad183 req-18c34d4d-bedd-473f-9f4f-10840d94e673 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] No waiting events found dispatching network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:22:17 user nova-compute[74959]: WARNING nova.compute.manager [req-de523f7d-fd86-487b-988d-7f23c60ad183 req-18c34d4d-bedd-473f-9f4f-10840d94e673 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received unexpected event network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c for instance with vm_state building and task_state spawning.
Nov 28 23:22:17 user nova-compute[74959]: INFO nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 28 23:22:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:22:17 user nova-compute[74959]: INFO nova.compute.manager [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Took 6.34 seconds to build instance.
Nov 28 23:22:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ec9fe1dc-83a4-437f-a13c-b21628fe0277 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.441s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Going to confirm migration 2 {{(pid=74959) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 23:22:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:22:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquired lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:22:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:22:37 user nova-compute[74959]: DEBUG nova.objects.instance [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'info_cache' on Instance uuid 6533acac-8b30-4eb5-ba8f-16560e1d5af7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG nova.network.neutron [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating instance_info_cache with network_info: [{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Releasing lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG nova.objects.instance [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'migration_context' on Instance uuid 6533acac-8b30-4eb5-ba8f-16560e1d5af7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG nova.objects.base [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Object Instance<6533acac-8b30-4eb5-ba8f-16560e1d5af7> lazy-loaded attributes: info_cache,migration_context {{(pid=74959) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.471s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:38 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Deleted allocation for migration a73d6c44-7730-4d98-9676-567d8df31291
Nov 28 23:22:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-941ea422-4879-4bc8-826d-95555d07af7d tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.729s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:48 user nova-compute[74959]: DEBUG nova.objects.instance [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:22:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:49 user nova-compute[74959]: INFO nova.compute.manager [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attaching volume 62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 to /dev/vdb
Nov 28 23:22:49 user nova-compute[74959]: DEBUG os_brick.utils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5265a73b-cff8-4db0-b94b-b6054bb09531]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.063s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c1d14-74f2-458e-8878-01f8b785875a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ed97fc-3c35-4d25-be45-bd1d048a9c23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2babb4-a7c2-47e5-8539-5889c209151f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:22:49 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:22:49 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d9e321-af00-44c8-adde-92717a5f2ca0]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG os_brick.utils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:22:49 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating existing volume attachment record: fbae5223-f6cc-4678-bc3d-d5deeff496ac {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:22:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:22:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:22:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:22:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:22:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating instance_info_cache with network_info: [{"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:22:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-15eae952-f2b9-4762-8daf-ef551b24931d" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:22:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:22:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:58 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:22:59 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:23:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8401MB free_disk=24.152862548828125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 15eae952-f2b9-4762-8daf-ef551b24931d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 1effa435-b29a-424b-938a-2d5a2bb61853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sonHIWgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:23:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:23:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:23:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:23:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:23:00 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac1de5c-e2a5-4860-a7d8-8362a395f4c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:23:00 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ce732e-e51e-45b1-92ad-320965e5b7d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4] added
Nov 28 23:23:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b49fb50-6871-4c85-a942-7b23d0fe2eb8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7551aba0-6bf9-45a9-b24b-b55648f78a3c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sonHIWgL {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sonHIWgL" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f491ef-d22b-4a31-bdd4-b38d3f8133d1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sonHIWgL'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6bbe62-ef93-4a0d-80ca-42ce73db74db]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ab2a2c-234f-4c62-9172-aef66bf9ed7e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c92adb-07d4-4842-b19d-3e7b81824aaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4, portal: 172.16.0.220,3260]
Nov 28 23:23:01 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4, portal: 172.16.0.220,3260] successful.
Nov 28 23:23:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb79e54-5aac-4222-bf83-02a8b0731408]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[540053d4-75f4-4939-9743-5bb9f9957be3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:01 user nova-compute[74959]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 (non-flash)
Nov 28 23:23:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:01 user nova-compute[74959]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 (non-flash)
Nov 28 23:23:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b7e2c7-23f4-461c-aa54-f01ac47f4001]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sonHIWgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23834656262626335', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834656262626335', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:23:02 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:23:02 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:23:02 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:23:02 user nova-compute[74959]:   <serial>62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4</serial>
Nov 28 23:23:02 user nova-compute[74959]: </disk>
Nov 28 23:23:02 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] No VIF found with MAC fa:16:3e:49:71:8b, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:23:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-29410040-a172-4a3f-b8cf-9b5a5f48d42b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.303s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:05 user nova-compute[74959]: INFO nova.compute.manager [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Detaching volume 62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4
Nov 28 23:23:05 user nova-compute[74959]: INFO nova.virt.block_device [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Attempting to driver detach volume 62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 from mountpoint /dev/vdb
Nov 28 23:23:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Attempting to detach device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:23:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:23:05 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:23:05 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:23:05 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:23:05 user nova-compute[74959]:   <serial>62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4</serial>
Nov 28 23:23:05 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:23:05 user nova-compute[74959]: </disk>
Nov 28 23:23:05 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:23:05 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully detached device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the persistent domain config.
Nov 28 23:23:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:23:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:23:05 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:23:05 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:23:05 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:23:05 user nova-compute[74959]:   <serial>62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4</serial>
Nov 28 23:23:05 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:23:05 user nova-compute[74959]: </disk>
Nov 28 23:23:05 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:23:05 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:23:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:23:21 user nova-compute[74959]: INFO nova.compute.claims [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Claim successful on node user
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.network.neutron [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:23:21 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:23:21 user nova-compute[74959]: INFO nova.virt.block_device [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Booting with volume snapshot ff43165a-5781-4785-b411-3a63ed6fe282 at /dev/vda
Nov 28 23:23:21 user nova-compute[74959]: DEBUG nova.policy [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '762e77e638ee4789a04c58868648d0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b91fdb847ce9aefc26052b7e87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Successfully created port: ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Successfully updated port: ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "refresh_cache-2bcc967b-32fe-4dfa-9f74-670a3b10fb15" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquired lock "refresh_cache-2bcc967b-32fe-4dfa-9f74-670a3b10fb15" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c55dba3-6288-45da-8be7-cc9009768d5d req-cd457463-760c-412c-92a1-111378edcb97 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received event network-changed-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-8c55dba3-6288-45da-8be7-cc9009768d5d req-cd457463-760c-412c-92a1-111378edcb97 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Refreshing instance network info cache due to event network-changed-ae0c9443-5386-4eab-ba2e-04736e978b70. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c55dba3-6288-45da-8be7-cc9009768d5d req-cd457463-760c-412c-92a1-111378edcb97 service nova] Acquiring lock "refresh_cache-2bcc967b-32fe-4dfa-9f74-670a3b10fb15" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:23:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG nova.network.neutron [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Updating instance_info_cache with network_info: [{"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Releasing lock "refresh_cache-2bcc967b-32fe-4dfa-9f74-670a3b10fb15" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Instance network_info: |[{"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c55dba3-6288-45da-8be7-cc9009768d5d req-cd457463-760c-412c-92a1-111378edcb97 service nova] Acquired lock "refresh_cache-2bcc967b-32fe-4dfa-9f74-670a3b10fb15" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-8c55dba3-6288-45da-8be7-cc9009768d5d req-cd457463-760c-412c-92a1-111378edcb97 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Refreshing network info cache for port ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-8c55dba3-6288-45da-8be7-cc9009768d5d req-cd457463-760c-412c-92a1-111378edcb97 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Updated VIF entry in instance network info cache for port ae0c9443-5386-4eab-ba2e-04736e978b70. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-8c55dba3-6288-45da-8be7-cc9009768d5d req-cd457463-760c-412c-92a1-111378edcb97 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Updating instance_info_cache with network_info: [{"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:23:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8c55dba3-6288-45da-8be7-cc9009768d5d req-cd457463-760c-412c-92a1-111378edcb97 service nova] Releasing lock "refresh_cache-2bcc967b-32fe-4dfa-9f74-670a3b10fb15" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:25 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15eae952-f2b9-4762-8daf-ef551b24931d is timed out.
Nov 28 23:23:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully detached device vdb from instance 15eae952-f2b9-4762-8daf-ef551b24931d from the live domain config.
Nov 28 23:23:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sonHIWgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:23:25 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91f619-9f58-41e7-85b8-2320c8b3ed02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:23:25 user nova-compute[74959]: No targets found.
Nov 28 23:23:25 user nova-compute[74959]: iSNS:
Nov 28 23:23:25 user nova-compute[74959]: No targets found.
Nov 28 23:23:25 user nova-compute[74959]: STATIC:
Nov 28 23:23:25 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4
Nov 28 23:23:25 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:23:25 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:23:25 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:23:25 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:23:25 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:23:25 user nova-compute[74959]: FIRMWARE:
Nov 28 23:23:25 user nova-compute[74959]: No targets found.
Nov 28 23:23:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:23:25 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:23:25 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc1c435-cdbc-4925-9576-40f354b2aa0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85b7951-86e8-4577-8744-45387c4e0847]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:25 user nova-compute[74959]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 (non-flash)
Nov 28 23:23:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:25 user nova-compute[74959]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 (non-flash)
Nov 28 23:23:25 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef42ea050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[26540a1d-df85-451a-b44b-a173e97b16dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bfd45f-e5ad-42bc-a0a3-6ef0e7f367cd]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b0694e-6e45-4c66-bde4-a5da6216739d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:23:25 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7f14da-503a-4097-b71e-4ac28726cb7f]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde142a1-8c60-4b98-865f-90902af22233]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa620b6-20db-4d35-b1e0-91c29ba6d9bf]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4, portal: 172.16.0.220,3260]
Nov 28 23:23:26 user nova-compute[74959]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4, portal: 172.16.0.220,3260] successful.
Nov 28 23:23:26 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62dfb6d0-e94d-43eb-8bd1-a5dd1ee895a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c49b5c-9eef-4959-afb9-9e5697a79c8b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] <== disconnect_volume: return (339ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:23:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG nova.objects.instance [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'flavor' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30591feb-fe14-49e6-9be6-70930ed22a3b tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.831s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG os_brick.utils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5acf4bd-3419-416a-86ae-ff01163fb781]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6138045f-87b5-4673-a711-6dae3a2c70c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f12de2a-be1f-47f0-a720-648ad44d87fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb641f4-e292-42dd-9fb8-2d16adfb063e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:23:27 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:23:27 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4f62a4-b84e-476d-bb44-d8db96e119dc]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG os_brick.utils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:23:27 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Updating existing volume attachment record: f9a36b7e-d8ac-45e8-a116-5caa477706d8 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:23:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:23:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:34 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:23:34 user nova-compute[74959]: INFO nova.compute.claims [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Claim successful on node user
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.network.neutron [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:23:35 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.policy [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f35aecf9a8247f58850821ae0e5db67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5559dee7c82847318eacecc9d1a8d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:23:35 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Creating image(s)
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "/opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "/opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:23:35 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Creating image(s)
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Ensure instance console log exists: /opt/stack/data/nova/instances/2bcc967b-32fe-4dfa-9f74-670a3b10fb15/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Start _get_guest_xml network_info=[{"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inkMuqYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bcc967b-32fe-4dfa-9f74-670a3b10fb15', 'attached_at': '', 'detached_at': '', 'volume_id': '850e8564-a526-4764-b7e1-92eca698b5f7', 'serial': '850e8564-a526-4764-b7e1-92eca698b5f7'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'f9a36b7e-d8ac-45e8-a116-5caa477706d8', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:23:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:23:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inkMuqYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:23:35 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:23:35 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:23:35 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b1233-12b6-4dad-aa0e-447bf99faf3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:23:35 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a68e12f-f53a-4b8c-a00e-04ab6be6d978]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7] added
Nov 28 23:23:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ba86ce-1437-42bc-b164-f29c36984af5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk 1073741824" returned: 0 in 0.051s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4caae4-6e69-4c70-9875-689bf81d2939]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v inkMuqYw {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v inkMuqYw" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f16d8-cd39-4f1c-8fa9-ec6d999a0173]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'inkMuqYw'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.057s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16599da-c134-453c-b447-eff90baf6348]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e837596-bd4a-4bf0-8be5-e90cf030c704]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[587707c4-e27d-431d-b002-7ccd1bb90073]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7, portal: 172.16.0.220,3260]
Nov 28 23:23:35 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7, portal: 172.16.0.220,3260] successful.
Nov 28 23:23:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee6e125-6572-40b0-8139-510b381803a1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfddb475-1157-48f4-a59d-12c7490f841e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:35 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:23:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:23:35 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:23:35 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:23:35 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d9887-0755-436e-a22b-6c8431c99ad2]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inkMuqYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.network.neutron [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Successfully created port: 98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Cannot resize image /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Ensure instance console log exists: /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.network.neutron [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Successfully updated port: 98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquired lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.network.neutron [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.compute.manager [req-42481d09-aca5-4c10-81e5-e1f4b7f69c6b req-fb343895-426e-4fd4-8b1b-7b978c77e31f service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received event network-changed-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.compute.manager [req-42481d09-aca5-4c10-81e5-e1f4b7f69c6b req-fb343895-426e-4fd4-8b1b-7b978c77e31f service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Refreshing instance network info cache due to event network-changed-98a233b1-b9be-4afc-9d8a-3823a13942f0. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-42481d09-aca5-4c10-81e5-e1f4b7f69c6b req-fb343895-426e-4fd4-8b1b-7b978c77e31f service nova] Acquiring lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:23:36 user nova-compute[74959]: DEBUG nova.network.neutron [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.neutron [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Updating instance_info_cache with network_info: [{"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Releasing lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Instance network_info: |[{"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-42481d09-aca5-4c10-81e5-e1f4b7f69c6b req-fb343895-426e-4fd4-8b1b-7b978c77e31f service nova] Acquired lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-42481d09-aca5-4c10-81e5-e1f4b7f69c6b req-fb343895-426e-4fd4-8b1b-7b978c77e31f service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Refreshing network info cache for port 98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Start _get_guest_xml network_info=[{"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '26235303533333634', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235303533333634', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:23:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:23:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-87466378',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-87466378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8746637',id=44,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPug8/LVdOTkfbpU/QFKTqNm8YjA8sOxz1GSvZKv0ogBwBXyMNYR00OosOtgUBWywbAfPxQpSJvXaETM+8NyY0OZ6AgydxQhG35anO1bddgWGer5ySHTC4GnyRJMnBPA4g==',key_name='tempest-keypair-981411389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5559dee7c82847318eacecc9d1a8d644',ramdisk_id='',reservation_id='r-6r8z38fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1195099830',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f35aecf9a8247f58850821ae0e5db67',uuid=3a042cfb-b827-426f-af5f-e0b0afe62154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Converting VIF {"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:25:d6,bridge_name='br-int',has_traffic_filtering=True,id=98a233b1-b9be-4afc-9d8a-3823a13942f0,network=Network(e1316cf1-6b60-4a95-a804-a151c36f999c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a233b1-b9') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.objects.instance [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a042cfb-b827-426f-af5f-e0b0afe62154 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1640791488',display_name='tempest-TestVolumeBootPattern-server-1640791488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1640791488',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-ep05jm5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:23:22Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=2bcc967b-32fe-4dfa-9f74-670a3b10fb15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:e9,bridge_name='br-int',has_traffic_filtering=True,id=ae0c9443-5386-4eab-ba2e-04736e978b70,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0c9443-53') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.objects.instance [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bcc967b-32fe-4dfa-9f74-670a3b10fb15 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:23:37 user nova-compute[74959]:   <uuid>3a042cfb-b827-426f-af5f-e0b0afe62154</uuid>
Nov 28 23:23:37 user nova-compute[74959]:   <name>instance-0000002c</name>
Nov 28 23:23:37 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:23:37 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:23:37 user nova-compute[74959]:   <metadata>
Nov 28 23:23:37 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:23:37 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-87466378</nova:name>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:23:37</nova:creationTime>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:23:37 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:23:37 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:owner>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:user uuid="2f35aecf9a8247f58850821ae0e5db67">tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member</nova:user>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:project uuid="5559dee7c82847318eacecc9d1a8d644">tempest-TestServerVolumeAttachScenarioOldVersion-1195099830</nova:project>
Nov 28 23:23:37 user nova-compute[74959]:       </nova:owner>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:ports>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:port uuid="98a233b1-b9be-4afc-9d8a-3823a13942f0">
Nov 28 23:23:37 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 23:23:37 user nova-compute[74959]:         </nova:port>
Nov 28 23:23:37 user nova-compute[74959]:       </nova:ports>
Nov 28 23:23:37 user nova-compute[74959]:     </nova:instance>
Nov 28 23:23:37 user nova-compute[74959]:   </metadata>
Nov 28 23:23:37 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:23:37 user nova-compute[74959]:     <system>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="serial">3a042cfb-b827-426f-af5f-e0b0afe62154</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="uuid">3a042cfb-b827-426f-af5f-e0b0afe62154</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:23:37 user nova-compute[74959]:     </system>
Nov 28 23:23:37 user nova-compute[74959]:   </sysinfo>
Nov 28 23:23:37 user nova-compute[74959]:   <os>
Nov 28 23:23:37 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:23:37 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:23:37 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:23:37 user nova-compute[74959]:   </os>
Nov 28 23:23:37 user nova-compute[74959]:   <features>
Nov 28 23:23:37 user nova-compute[74959]:     <acpi/>
Nov 28 23:23:37 user nova-compute[74959]:     <apic/>
Nov 28 23:23:37 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:23:37 user nova-compute[74959]:   </features>
Nov 28 23:23:37 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:23:37 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:23:37 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:23:37 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:23:37 user nova-compute[74959]:   </clock>
Nov 28 23:23:37 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:23:37 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:23:37 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:23:37 user nova-compute[74959]:   </cpu>
Nov 28 23:23:37 user nova-compute[74959]:   <devices>
Nov 28 23:23:37 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:23:37 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:23:37 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk"/>
Nov 28 23:23:37 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:23:37 user nova-compute[74959]:     </disk>
Nov 28 23:23:37 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:23:37 user nova-compute[74959]:       <mac address="fa:16:3e:56:25:d6"/>
Nov 28 23:23:37 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:23:37 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:23:37 user nova-compute[74959]:       <target dev="tap98a233b1-b9"/>
Nov 28 23:23:37 user nova-compute[74959]:     </interface>
Nov 28 23:23:37 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:23:37 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/console.log" append="off"/>
Nov 28 23:23:37 user nova-compute[74959]:     </serial>
Nov 28 23:23:37 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:23:37 user nova-compute[74959]:     <video>
Nov 28 23:23:37 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:23:37 user nova-compute[74959]:     </video>
Nov 28 23:23:37 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:23:37 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:23:37 user nova-compute[74959]:     </rng>
Nov 28 23:23:37 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:23:37 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:23:37 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:23:37 user nova-compute[74959]:     </memballoon>
Nov 28 23:23:37 user nova-compute[74959]:   </devices>
Nov 28 23:23:37 user nova-compute[74959]: </domain>
Nov 28 23:23:37 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-87466378',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-87466378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8746637',id=44,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPug8/LVdOTkfbpU/QFKTqNm8YjA8sOxz1GSvZKv0ogBwBXyMNYR00OosOtgUBWywbAfPxQpSJvXaETM+8NyY0OZ6AgydxQhG35anO1bddgWGer5ySHTC4GnyRJMnBPA4g==',key_name='tempest-keypair-981411389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5559dee7c82847318eacecc9d1a8d644',ramdisk_id='',reservation_id='r-6r8z38fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1195099830',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f35aecf9a8247f58850821ae0e5db67',uuid=3a042cfb-b827-426f-af5f-e0b0afe62154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Converting VIF {"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:25:d6,bridge_name='br-int',has_traffic_filtering=True,id=98a233b1-b9be-4afc-9d8a-3823a13942f0,network=Network(e1316cf1-6b60-4a95-a804-a151c36f999c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a233b1-b9') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG os_vif [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:25:d6,bridge_name='br-int',has_traffic_filtering=True,id=98a233b1-b9be-4afc-9d8a-3823a13942f0,network=Network(e1316cf1-6b60-4a95-a804-a151c36f999c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a233b1-b9') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4eaaa92-f81b-5731-9d7f-3a827dd303a2', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:23:37 user nova-compute[74959]:   <uuid>2bcc967b-32fe-4dfa-9f74-670a3b10fb15</uuid>
Nov 28 23:23:37 user nova-compute[74959]:   <name>instance-0000002b</name>
Nov 28 23:23:37 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:23:37 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:23:37 user nova-compute[74959]:   <metadata>
Nov 28 23:23:37 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:23:37 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:name>tempest-TestVolumeBootPattern-server-1640791488</nova:name>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:23:35</nova:creationTime>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:23:37 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:23:37 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:owner>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:user uuid="762e77e638ee4789a04c58868648d0a0">tempest-TestVolumeBootPattern-1296185511-project-member</nova:user>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:project uuid="1e1c6b91fdb847ce9aefc26052b7e87c">tempest-TestVolumeBootPattern-1296185511</nova:project>
Nov 28 23:23:37 user nova-compute[74959]:       </nova:owner>
Nov 28 23:23:37 user nova-compute[74959]:       <nova:ports>
Nov 28 23:23:37 user nova-compute[74959]:         <nova:port uuid="ae0c9443-5386-4eab-ba2e-04736e978b70">
Nov 28 23:23:37 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:23:37 user nova-compute[74959]:         </nova:port>
Nov 28 23:23:37 user nova-compute[74959]:       </nova:ports>
Nov 28 23:23:37 user nova-compute[74959]:     </nova:instance>
Nov 28 23:23:37 user nova-compute[74959]:   </metadata>
Nov 28 23:23:37 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:23:37 user nova-compute[74959]:     <system>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="serial">2bcc967b-32fe-4dfa-9f74-670a3b10fb15</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="uuid">2bcc967b-32fe-4dfa-9f74-670a3b10fb15</entry>
Nov 28 23:23:37 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:23:37 user nova-compute[74959]:     </system>
Nov 28 23:23:37 user nova-compute[74959]:   </sysinfo>
Nov 28 23:23:37 user nova-compute[74959]:   <os>
Nov 28 23:23:37 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:23:37 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:23:37 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:23:37 user nova-compute[74959]:   </os>
Nov 28 23:23:37 user nova-compute[74959]:   <features>
Nov 28 23:23:37 user nova-compute[74959]:     <acpi/>
Nov 28 23:23:37 user nova-compute[74959]:     <apic/>
Nov 28 23:23:37 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:23:37 user nova-compute[74959]:   </features>
Nov 28 23:23:37 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:23:37 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:23:37 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:23:37 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:23:37 user nova-compute[74959]:   </clock>
Nov 28 23:23:37 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:23:37 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:23:37 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:23:37 user nova-compute[74959]:   </cpu>
Nov 28 23:23:37 user nova-compute[74959]:   <devices>
Nov 28 23:23:37 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:23:37 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:23:37 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:23:37 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:23:37 user nova-compute[74959]:       <serial>850e8564-a526-4764-b7e1-92eca698b5f7</serial>
Nov 28 23:23:37 user nova-compute[74959]:     </disk>
Nov 28 23:23:37 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:23:37 user nova-compute[74959]:       <mac address="fa:16:3e:a9:62:e9"/>
Nov 28 23:23:37 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:23:37 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:23:37 user nova-compute[74959]:       <target dev="tapae0c9443-53"/>
Nov 28 23:23:37 user nova-compute[74959]:     </interface>
Nov 28 23:23:37 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:23:37 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/2bcc967b-32fe-4dfa-9f74-670a3b10fb15/console.log" append="off"/>
Nov 28 23:23:37 user nova-compute[74959]:     </serial>
Nov 28 23:23:37 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:23:37 user nova-compute[74959]:     <video>
Nov 28 23:23:37 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:23:37 user nova-compute[74959]:     </video>
Nov 28 23:23:37 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:23:37 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:23:37 user nova-compute[74959]:     </rng>
Nov 28 23:23:37 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:23:37 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:23:37 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:23:37 user nova-compute[74959]:     </memballoon>
Nov 28 23:23:37 user nova-compute[74959]:   </devices>
Nov 28 23:23:37 user nova-compute[74959]: </domain>
Nov 28 23:23:37 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1640791488',display_name='tempest-TestVolumeBootPattern-server-1640791488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1640791488',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-ep05jm5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:23:22Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=2bcc967b-32fe-4dfa-9f74-670a3b10fb15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:e9,bridge_name='br-int',has_traffic_filtering=True,id=ae0c9443-5386-4eab-ba2e-04736e978b70,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0c9443-53') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG os_vif [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:e9,bridge_name='br-int',has_traffic_filtering=True,id=ae0c9443-5386-4eab-ba2e-04736e978b70,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0c9443-53') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e449b05e-bdb6-5556-8b12-a7f9a49d4434', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98a233b1-b9, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98a233b1-b9, col_values=(('qos', UUID('0712804b-5078-4243-ac16-fec68e1960f8')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98a233b1-b9, col_values=(('external_ids', {'iface-id': '98a233b1-b9be-4afc-9d8a-3823a13942f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:25:d6', 'vm-uuid': '3a042cfb-b827-426f-af5f-e0b0afe62154'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: INFO os_vif [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:25:d6,bridge_name='br-int',has_traffic_filtering=True,id=98a233b1-b9be-4afc-9d8a-3823a13942f0,network=Network(e1316cf1-6b60-4a95-a804-a151c36f999c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a233b1-b9')
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae0c9443-53, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae0c9443-53, col_values=(('qos', UUID('996d109c-1872-4aa0-a87c-3d7120da83cf')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae0c9443-53, col_values=(('external_ids', {'iface-id': 'ae0c9443-5386-4eab-ba2e-04736e978b70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:62:e9', 'vm-uuid': '2bcc967b-32fe-4dfa-9f74-670a3b10fb15'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:37 user nova-compute[74959]: INFO os_vif [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:e9,bridge_name='br-int',has_traffic_filtering=True,id=ae0c9443-5386-4eab-ba2e-04736e978b70,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0c9443-53')
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] No VIF found with MAC fa:16:3e:56:25:d6, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No VIF found with MAC fa:16:3e:a9:62:e9, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-42481d09-aca5-4c10-81e5-e1f4b7f69c6b req-fb343895-426e-4fd4-8b1b-7b978c77e31f service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Updated VIF entry in instance network info cache for port 98a233b1-b9be-4afc-9d8a-3823a13942f0. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-42481d09-aca5-4c10-81e5-e1f4b7f69c6b req-fb343895-426e-4fd4-8b1b-7b978c77e31f service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Updating instance_info_cache with network_info: [{"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:23:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-42481d09-aca5-4c10-81e5-e1f4b7f69c6b req-fb343895-426e-4fd4-8b1b-7b978c77e31f service nova] Releasing lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-6530d595-2e7f-4980-b6e8-483ededdbfaf req-115c63c7-eaf2-4138-9bcf-f7efc7582a69 service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received event network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6530d595-2e7f-4980-b6e8-483ededdbfaf req-115c63c7-eaf2-4138-9bcf-f7efc7582a69 service nova] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6530d595-2e7f-4980-b6e8-483ededdbfaf req-115c63c7-eaf2-4138-9bcf-f7efc7582a69 service nova] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6530d595-2e7f-4980-b6e8-483ededdbfaf req-115c63c7-eaf2-4138-9bcf-f7efc7582a69 service nova] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-6530d595-2e7f-4980-b6e8-483ededdbfaf req-115c63c7-eaf2-4138-9bcf-f7efc7582a69 service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] No waiting events found dispatching network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:23:39 user nova-compute[74959]: WARNING nova.compute.manager [req-6530d595-2e7f-4980-b6e8-483ededdbfaf req-115c63c7-eaf2-4138-9bcf-f7efc7582a69 service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received unexpected event network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 for instance with vm_state building and task_state spawning.
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-5b717c52-db6b-4592-b14e-01e3e880f47f req-165b8112-2bb0-4de2-baae-a43d3e0a6d05 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received event network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5b717c52-db6b-4592-b14e-01e3e880f47f req-165b8112-2bb0-4de2-baae-a43d3e0a6d05 service nova] Acquiring lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5b717c52-db6b-4592-b14e-01e3e880f47f req-165b8112-2bb0-4de2-baae-a43d3e0a6d05 service nova] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5b717c52-db6b-4592-b14e-01e3e880f47f req-165b8112-2bb0-4de2-baae-a43d3e0a6d05 service nova] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-5b717c52-db6b-4592-b14e-01e3e880f47f req-165b8112-2bb0-4de2-baae-a43d3e0a6d05 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] No waiting events found dispatching network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:23:39 user nova-compute[74959]: WARNING nova.compute.manager [req-5b717c52-db6b-4592-b14e-01e3e880f47f req-165b8112-2bb0-4de2-baae-a43d3e0a6d05 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received unexpected event network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 for instance with vm_state building and task_state spawning.
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-16b0d528-17a3-406b-be94-4a9a78f0538a req-28ab2113-3789-4da6-9e10-1c9dd7dbcde3 service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received event network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-16b0d528-17a3-406b-be94-4a9a78f0538a req-28ab2113-3789-4da6-9e10-1c9dd7dbcde3 service nova] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-16b0d528-17a3-406b-be94-4a9a78f0538a req-28ab2113-3789-4da6-9e10-1c9dd7dbcde3 service nova] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-16b0d528-17a3-406b-be94-4a9a78f0538a req-28ab2113-3789-4da6-9e10-1c9dd7dbcde3 service nova] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-16b0d528-17a3-406b-be94-4a9a78f0538a req-28ab2113-3789-4da6-9e10-1c9dd7dbcde3 service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] No waiting events found dispatching network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:23:41 user nova-compute[74959]: WARNING nova.compute.manager [req-16b0d528-17a3-406b-be94-4a9a78f0538a req-28ab2113-3789-4da6-9e10-1c9dd7dbcde3 service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received unexpected event network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 for instance with vm_state building and task_state spawning.
Nov 28 23:23:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-d1021e38-0f3e-41e1-ac79-b75641c3889d req-5e1de443-719b-44e2-a085-a65c3d6e3d6b service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received event network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d1021e38-0f3e-41e1-ac79-b75641c3889d req-5e1de443-719b-44e2-a085-a65c3d6e3d6b service nova] Acquiring lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d1021e38-0f3e-41e1-ac79-b75641c3889d req-5e1de443-719b-44e2-a085-a65c3d6e3d6b service nova] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d1021e38-0f3e-41e1-ac79-b75641c3889d req-5e1de443-719b-44e2-a085-a65c3d6e3d6b service nova] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:41 user nova-compute[74959]: DEBUG nova.compute.manager [req-d1021e38-0f3e-41e1-ac79-b75641c3889d req-5e1de443-719b-44e2-a085-a65c3d6e3d6b service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] No waiting events found dispatching network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:23:41 user nova-compute[74959]: WARNING nova.compute.manager [req-d1021e38-0f3e-41e1-ac79-b75641c3889d req-5e1de443-719b-44e2-a085-a65c3d6e3d6b service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received unexpected event network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 for instance with vm_state building and task_state spawning.
Nov 28 23:23:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:23:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Instance spawned successfully.
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:23:42 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Instance spawned successfully.
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:23:42 user nova-compute[74959]: INFO nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:23:42 user nova-compute[74959]: INFO nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 28 23:23:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:23:42 user nova-compute[74959]: INFO nova.compute.manager [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Took 7.76 seconds to build instance.
Nov 28 23:23:42 user nova-compute[74959]: INFO nova.compute.manager [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Took 21.36 seconds to build instance.
Nov 28 23:23:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-30d3e2ba-2cdf-4458-b5de-2e45529d705f tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.865s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-01a510e3-81df-4b15-9185-ce189bf961d6 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.476s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:23:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:23:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:23:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:23:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:23:53 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:23:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating instance_info_cache with network_info: [{"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:23:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-6533acac-8b30-4eb5-ba8f-16560e1d5af7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:23:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:23:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:23:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:23:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:24:02 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:24:02 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8041MB free_disk=25.103988647460938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 15eae952-f2b9-4762-8daf-ef551b24931d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 1effa435-b29a-424b-938a-2d5a2bb61853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 2bcc967b-32fe-4dfa-9f74-670a3b10fb15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 3a042cfb-b827-426f-af5f-e0b0afe62154 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-0fd594da-7cab-4e6b-b470-f3b30f40dcad req-9dc7154d-6f22-4813-8a68-fc12828a9438 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-changed-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-0fd594da-7cab-4e6b-b470-f3b30f40dcad req-9dc7154d-6f22-4813-8a68-fc12828a9438 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Refreshing instance network info cache due to event network-changed-2c30f0a4-c515-41ca-8221-127697ead54c. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0fd594da-7cab-4e6b-b470-f3b30f40dcad req-9dc7154d-6f22-4813-8a68-fc12828a9438 service nova] Acquiring lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0fd594da-7cab-4e6b-b470-f3b30f40dcad req-9dc7154d-6f22-4813-8a68-fc12828a9438 service nova] Acquired lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-0fd594da-7cab-4e6b-b470-f3b30f40dcad req-9dc7154d-6f22-4813-8a68-fc12828a9438 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Refreshing network info cache for port 2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-0fd594da-7cab-4e6b-b470-f3b30f40dcad req-9dc7154d-6f22-4813-8a68-fc12828a9438 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updated VIF entry in instance network info cache for port 2c30f0a4-c515-41ca-8221-127697ead54c. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-0fd594da-7cab-4e6b-b470-f3b30f40dcad req-9dc7154d-6f22-4813-8a68-fc12828a9438 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating instance_info_cache with network_info: [{"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0fd594da-7cab-4e6b-b470-f3b30f40dcad req-9dc7154d-6f22-4813-8a68-fc12828a9438 service nova] Releasing lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG nova.objects.instance [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'flavor' on Instance uuid 1effa435-b29a-424b-938a-2d5a2bb61853 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:24:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:04 user nova-compute[74959]: INFO nova.compute.manager [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Attaching volume cbfa4192-1bdf-4888-883e-53b7535e2d5b to /dev/vdb
Nov 28 23:24:04 user nova-compute[74959]: DEBUG os_brick.utils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baed351-d044-4d36-8c9e-1aceeb805243]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfe1fcb-a84f-4228-a04b-85f34bf182a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b590c6f-a0e6-4137-acc4-c1604b46d844]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4524bd38-4c0e-4064-8bb8-bbaa4dca7752]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:24:04 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:24:04 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9033390b-174a-4897-9fc4-e904993c9713]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG os_brick.utils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:24:04 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating existing volume attachment record: 8b64e71c-3f9d-411f-82d4-b201e28e5950 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:24:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNHQpwRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:24:11 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:24:11 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:24:11 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea30a032-6e66-48a1-8bb4-3076dd4b7f91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:24:11 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddde089-57e2-4d13-89fb-74c0d51c9c04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b] added
Nov 28 23:24:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ff9dc-3c5e-41df-84ef-11434b8b6b04]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a61808-3eec-4d95-870e-e1f9b6c24014]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNHQpwRD {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNHQpwRD" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6801d520-3418-4ae2-bba8-f75deed3479c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FNHQpwRD'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5421ba4a-5acd-403d-9106-ec2e38479857]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7105dafa-9b82-4797-b0c6-9f0a0e04239b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:24:11 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:24:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:24:11 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:24:11 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:24:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f9b96-f60a-4952-992c-2c95b3ed6c17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b, portal: 172.16.0.220,3260]
Nov 28 23:24:12 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b, portal: 172.16.0.220,3260] successful.
Nov 28 23:24:12 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd37ce0-7d81-4a0a-a021-6e037fc05229]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c218e836-bb30-4f9c-8763-d4d653dac00e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:24:12 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:24:12 user nova-compute[74959]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b (non-flash)
Nov 28 23:24:12 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:24:12 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:24:12 user nova-compute[74959]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b (non-flash)
Nov 28 23:24:12 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f542dbe4-908d-408e-a347-441c19beeb6e]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNHQpwRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23236303266646561', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236303266646561', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG nova.objects.instance [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'flavor' on Instance uuid 1effa435-b29a-424b-938a-2d5a2bb61853 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:24:13 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:24:13 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:24:13 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:24:13 user nova-compute[74959]:   <serial>cbfa4192-1bdf-4888-883e-53b7535e2d5b</serial>
Nov 28 23:24:13 user nova-compute[74959]: </disk>
Nov 28 23:24:13 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No VIF found with MAC fa:16:3e:66:b2:b6, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:24:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-dec53e25-4312-4d6b-b332-b65d6c270fd3 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.632s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:17 user nova-compute[74959]: INFO nova.compute.manager [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Detaching volume cbfa4192-1bdf-4888-883e-53b7535e2d5b
Nov 28 23:24:17 user nova-compute[74959]: INFO nova.virt.block_device [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Attempting to driver detach volume cbfa4192-1bdf-4888-883e-53b7535e2d5b from mountpoint /dev/vdb
Nov 28 23:24:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Attempting to detach device vdb from instance 1effa435-b29a-424b-938a-2d5a2bb61853 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:24:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:24:17 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:24:17 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:24:17 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:24:17 user nova-compute[74959]:   <serial>cbfa4192-1bdf-4888-883e-53b7535e2d5b</serial>
Nov 28 23:24:17 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:24:17 user nova-compute[74959]: </disk>
Nov 28 23:24:17 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:24:17 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Successfully detached device vdb from instance 1effa435-b29a-424b-938a-2d5a2bb61853 from the persistent domain config.
Nov 28 23:24:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1effa435-b29a-424b-938a-2d5a2bb61853 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:24:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:24:17 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:24:17 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:24:17 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:24:17 user nova-compute[74959]:   <serial>cbfa4192-1bdf-4888-883e-53b7535e2d5b</serial>
Nov 28 23:24:17 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:24:17 user nova-compute[74959]: </disk>
Nov 28 23:24:17 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:24:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1effa435-b29a-424b-938a-2d5a2bb61853 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:24:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:23 user nova-compute[74959]: INFO nova.compute.manager [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Terminating instance
Nov 28 23:24:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-173dedb2-d3ea-4d0b-bcd4-ccaac40ca64f req-7a6d5f49-74d5-41f4-9e73-ab3524bcc5c9 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received event network-vif-unplugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-173dedb2-d3ea-4d0b-bcd4-ccaac40ca64f req-7a6d5f49-74d5-41f4-9e73-ab3524bcc5c9 service nova] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-173dedb2-d3ea-4d0b-bcd4-ccaac40ca64f req-7a6d5f49-74d5-41f4-9e73-ab3524bcc5c9 service nova] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-173dedb2-d3ea-4d0b-bcd4-ccaac40ca64f req-7a6d5f49-74d5-41f4-9e73-ab3524bcc5c9 service nova] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-173dedb2-d3ea-4d0b-bcd4-ccaac40ca64f req-7a6d5f49-74d5-41f4-9e73-ab3524bcc5c9 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] No waiting events found dispatching network-vif-unplugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:24:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-173dedb2-d3ea-4d0b-bcd4-ccaac40ca64f req-7a6d5f49-74d5-41f4-9e73-ab3524bcc5c9 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received event network-vif-unplugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Instance destroyed successfully.
Nov 28 23:24:24 user nova-compute[74959]: DEBUG nova.objects.instance [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lazy-loading 'resources' on Instance uuid 15eae952-f2b9-4762-8daf-ef551b24931d {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1314426489',display_name='tempest-SnapshotDataIntegrityTests-server-1314426489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1314426489',id=38,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCVFJyLkYJJjP5XubRL3qbaL4RoZMx1FpVuYZ1KR0onlhaqb78PTLQpH/PVqdkxpIuJ96ieUoG1UiSpbkXxEp4RHmrE7eZlNF+fY6PHvVAaRqDGvKjRg4JdKJBv/Ooa2Q==',key_name='tempest-keypair-441840350',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d1b6e9fa4f1453092f9640336ab087f',ramdisk_id='',reservation_id='r-cyf97fgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-824424259',owner_user_name='tempest-SnapshotDataIntegrityTests-824424259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='367ecd21410f4592ab3f54684cf4b74c',uuid=15eae952-f2b9-4762-8daf-ef551b24931d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Converting VIF {"id": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "address": "fa:16:3e:49:71:8b", "network": {"id": "967eb008-63ba-40aa-8523-ec5a9631e715", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-35096788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d1b6e9fa4f1453092f9640336ab087f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258fccdb-aa", "ovs_interfaceid": "258fccdb-aa83-445c-ac76-c10826ff3fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:71:8b,bridge_name='br-int',has_traffic_filtering=True,id=258fccdb-aa83-445c-ac76-c10826ff3fa9,network=Network(967eb008-63ba-40aa-8523-ec5a9631e715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258fccdb-aa') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG os_vif [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:71:8b,bridge_name='br-int',has_traffic_filtering=True,id=258fccdb-aa83-445c-ac76-c10826ff3fa9,network=Network(967eb008-63ba-40aa-8523-ec5a9631e715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258fccdb-aa') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap258fccdb-aa, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bf1c648-15a5-4a8e-8cc3-55871674541c) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:24:24 user nova-compute[74959]: INFO os_vif [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:71:8b,bridge_name='br-int',has_traffic_filtering=True,id=258fccdb-aa83-445c-ac76-c10826ff3fa9,network=Network(967eb008-63ba-40aa-8523-ec5a9631e715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258fccdb-aa')
Nov 28 23:24:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Deleting instance files /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d_del
Nov 28 23:24:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Deletion of /opt/stack/data/nova/instances/15eae952-f2b9-4762-8daf-ef551b24931d_del complete
Nov 28 23:24:24 user nova-compute[74959]: INFO nova.compute.manager [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 23:24:24 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:24:24 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:24:25 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Took 1.11 seconds to deallocate network for instance.
Nov 28 23:24:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-58f1303c-9b76-41b4-b839-da600a43b88e req-03bff9b7-b289-4b13-ae2a-72569d417f84 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received event network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-58f1303c-9b76-41b4-b839-da600a43b88e req-03bff9b7-b289-4b13-ae2a-72569d417f84 service nova] Acquiring lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-58f1303c-9b76-41b4-b839-da600a43b88e req-03bff9b7-b289-4b13-ae2a-72569d417f84 service nova] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-58f1303c-9b76-41b4-b839-da600a43b88e req-03bff9b7-b289-4b13-ae2a-72569d417f84 service nova] Lock "15eae952-f2b9-4762-8daf-ef551b24931d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-58f1303c-9b76-41b4-b839-da600a43b88e req-03bff9b7-b289-4b13-ae2a-72569d417f84 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] No waiting events found dispatching network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:24:25 user nova-compute[74959]: WARNING nova.compute.manager [req-58f1303c-9b76-41b4-b839-da600a43b88e req-03bff9b7-b289-4b13-ae2a-72569d417f84 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received unexpected event network-vif-plugged-258fccdb-aa83-445c-ac76-c10826ff3fa9 for instance with vm_state deleted and task_state None.
Nov 28 23:24:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-58f1303c-9b76-41b4-b839-da600a43b88e req-03bff9b7-b289-4b13-ae2a-72569d417f84 service nova] [instance: 15eae952-f2b9-4762-8daf-ef551b24931d] Received event network-vif-deleted-258fccdb-aa83-445c-ac76-c10826ff3fa9 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:24:25 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Deleted allocations for instance 15eae952-f2b9-4762-8daf-ef551b24931d
Nov 28 23:24:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-329eef59-97c2-4e79-8f3f-41fbef20a589 tempest-SnapshotDataIntegrityTests-824424259 tempest-SnapshotDataIntegrityTests-824424259-project-member] Lock "15eae952-f2b9-4762-8daf-ef551b24931d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:29 user nova-compute[74959]: INFO nova.compute.manager [None req-01910a07-66cc-4370-9c77-bf50b91ca293 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Get console output
Nov 28 23:24:29 user nova-compute[74959]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 23:24:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1effa435-b29a-424b-938a-2d5a2bb61853 is timed out.
Nov 28 23:24:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Successfully detached device vdb from instance 1effa435-b29a-424b-938a-2d5a2bb61853 from the live domain config.
Nov 28 23:24:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNHQpwRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:24:37 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2df0e3-eb0a-4376-9cf4-3c06544de258]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:24:37 user nova-compute[74959]: No targets found.
Nov 28 23:24:37 user nova-compute[74959]: iSNS:
Nov 28 23:24:37 user nova-compute[74959]: No targets found.
Nov 28 23:24:37 user nova-compute[74959]: STATIC:
Nov 28 23:24:37 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b
Nov 28 23:24:37 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:24:37 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:24:37 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:24:37 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:24:37 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:24:37 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7
Nov 28 23:24:37 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:24:37 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:24:37 user nova-compute[74959]: FIRMWARE:
Nov 28 23:24:37 user nova-compute[74959]: No targets found.
Nov 28 23:24:37 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:24:37 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:24:37 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[80836e8e-54a2-47f2-a09d-93a7c22ca62d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c51d535-6590-4215-9381-ec01a8d0f2c7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:24:37 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:24:37 user nova-compute[74959]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b (non-flash)
Nov 28 23:24:37 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:24:37 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:24:37 user nova-compute[74959]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b (non-flash)
Nov 28 23:24:37 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec36d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b'): ({'sdc'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Removing single pathed devices sdc {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9ec886-1e80-4c71-9bca-45a1fc786b26]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[77754eef-bd6d-41d2-9451-b72684410b0a]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Flushing IO for device /dev/sdc {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3418eaa-0807-4516-8d25-5c3b406f6a40]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d39a3b-ae1f-4990-bc45-4630ba273436]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e607a4-f2c0-42df-ae0c-7e169ed54ad3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef2afc-f092-4ff4-9b51-829b4d08a11c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b, portal: 172.16.0.220,3260]
Nov 28 23:24:37 user nova-compute[74959]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b, portal: 172.16.0.220,3260] successful.
Nov 28 23:24:37 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfa4192-1bdf-4888-883e-53b7535e2d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f46322-761d-4584-9506-951bf7187229]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] <== disconnect_volume: return (303ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:24:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:24:38 user nova-compute[74959]: DEBUG nova.objects.instance [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'flavor' on Instance uuid 1effa435-b29a-424b-938a-2d5a2bb61853 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:24:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8e862937-b6de-4a6c-a7d7-1d37020c5e44 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.660s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:24:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:24:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:24:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:24:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:24:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:24:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:24:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:24:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:25:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:25:04 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:25:04 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8328MB free_disk=25.128082275390625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 1effa435-b29a-424b-938a-2d5a2bb61853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 2bcc967b-32fe-4dfa-9f74-670a3b10fb15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 3a042cfb-b827-426f-af5f-e0b0afe62154 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:25:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:25:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:25:11 user nova-compute[74959]: INFO nova.compute.manager [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] instance snapshotting
Nov 28 23:25:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Beginning live snapshot process
Nov 28 23:25:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:11 user nova-compute[74959]: INFO nova.compute.manager [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Terminating instance
Nov 28 23:25:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:25:11 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json -f qcow2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json -f qcow2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-7fc9c97d-63c3-4e69-a65e-166600ccd99d req-675143a7-3004-4463-aa07-cfd812c0b32c service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received event network-vif-unplugged-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7fc9c97d-63c3-4e69-a65e-166600ccd99d req-675143a7-3004-4463-aa07-cfd812c0b32c service nova] Acquiring lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7fc9c97d-63c3-4e69-a65e-166600ccd99d req-675143a7-3004-4463-aa07-cfd812c0b32c service nova] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7fc9c97d-63c3-4e69-a65e-166600ccd99d req-675143a7-3004-4463-aa07-cfd812c0b32c service nova] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-7fc9c97d-63c3-4e69-a65e-166600ccd99d req-675143a7-3004-4463-aa07-cfd812c0b32c service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] No waiting events found dispatching network-vif-unplugged-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-7fc9c97d-63c3-4e69-a65e-166600ccd99d req-675143a7-3004-4463-aa07-cfd812c0b32c service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received event network-vif-unplugged-ae0c9443-5386-4eab-ba2e-04736e978b70 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqfh2emxl/5c1887221b234f439cf72482cce4aca2.delta 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqfh2emxl/5c1887221b234f439cf72482cce4aca2.delta 1073741824" returned: 0 in 0.051s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 23:25:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Instance destroyed successfully.
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.objects.instance [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'resources' on Instance uuid 2bcc967b-32fe-4dfa-9f74-670a3b10fb15 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1640791488',display_name='tempest-TestVolumeBootPattern-server-1640791488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1640791488',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:23:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-ep05jm5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:23:42Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=2bcc967b-32fe-4dfa-9f74-670a3b10fb15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "ae0c9443-5386-4eab-ba2e-04736e978b70", "address": "fa:16:3e:a9:62:e9", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0c9443-53", "ovs_interfaceid": "ae0c9443-5386-4eab-ba2e-04736e978b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:e9,bridge_name='br-int',has_traffic_filtering=True,id=ae0c9443-5386-4eab-ba2e-04736e978b70,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0c9443-53') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_vif [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:e9,bridge_name='br-int',has_traffic_filtering=True,id=ae0c9443-5386-4eab-ba2e-04736e978b70,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0c9443-53') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae0c9443-53, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=996d109c-1872-4aa0-a87c-3d7120da83cf) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:25:13 user nova-compute[74959]: INFO os_vif [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:e9,bridge_name='br-int',has_traffic_filtering=True,id=ae0c9443-5386-4eab-ba2e-04736e978b70,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0c9443-53')
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inkMuqYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:25:13 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dfdabe-fe02-49c7-8dc2-c13cb9f53073]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:25:13 user nova-compute[74959]: No targets found.
Nov 28 23:25:13 user nova-compute[74959]: iSNS:
Nov 28 23:25:13 user nova-compute[74959]: No targets found.
Nov 28 23:25:13 user nova-compute[74959]: STATIC:
Nov 28 23:25:13 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:25:13 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:25:13 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:25:13 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7
Nov 28 23:25:13 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:25:13 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:25:13 user nova-compute[74959]: FIRMWARE:
Nov 28 23:25:13 user nova-compute[74959]: No targets found.
Nov 28 23:25:13 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:25:13 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:25:13 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7db886a-2d49-4a16-905b-3fd5492a8e25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[15171647-52a0-41d8-a03e-fb8051817b41]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:25:13 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:25:13 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:25:13 user nova-compute[74959]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 (non-flash)
Nov 28 23:25:13 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc7639a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4978eafb-9c64-4b8c-b929-1d22861520f3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[20de1f50-e954-4abe-91f1-feece056e089]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.098s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a29ac70-c216-4bce-95df-3635150522e8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e764bc-1982-4f58-8063-4ec211acea88]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff17b245-949b-40c1-a75e-faf78f85f537]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a7c97-abd0-4d82-b550-841b4d553224]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7, portal: 172.16.0.220,3260]
Nov 28 23:25:13 user nova-compute[74959]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7, portal: 172.16.0.220,3260] successful.
Nov 28 23:25:13 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850e8564-a526-4764-b7e1-92eca698b5f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e41c30e-c583-4b24-a35e-0d7fbb864050]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== disconnect_volume: return (451ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:25:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Deleting instance files /opt/stack/data/nova/instances/2bcc967b-32fe-4dfa-9f74-670a3b10fb15_del
Nov 28 23:25:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Deletion of /opt/stack/data/nova/instances/2bcc967b-32fe-4dfa-9f74-670a3b10fb15_del complete
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74959) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 23:25:13 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 23:25:13 user nova-compute[74959]: INFO nova.compute.manager [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Took 2.02 seconds to destroy the instance on the hypervisor.
Nov 28 23:25:13 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:25:13 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:25:14 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:25:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqfh2emxl/5c1887221b234f439cf72482cce4aca2.delta /opt/stack/data/nova/instances/snapshots/tmpqfh2emxl/5c1887221b234f439cf72482cce4aca2 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqfh2emxl/5c1887221b234f439cf72482cce4aca2.delta /opt/stack/data/nova/instances/snapshots/tmpqfh2emxl/5c1887221b234f439cf72482cce4aca2" returned: 0 in 0.294s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Snapshot extracted, beginning image upload
Nov 28 23:25:14 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:25:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-c56e283b-a888-4b59-a670-01bef7140005 req-90ae9c1b-3111-4c30-bc2c-7ba372d36d35 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received event network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c56e283b-a888-4b59-a670-01bef7140005 req-90ae9c1b-3111-4c30-bc2c-7ba372d36d35 service nova] Acquiring lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c56e283b-a888-4b59-a670-01bef7140005 req-90ae9c1b-3111-4c30-bc2c-7ba372d36d35 service nova] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c56e283b-a888-4b59-a670-01bef7140005 req-90ae9c1b-3111-4c30-bc2c-7ba372d36d35 service nova] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-c56e283b-a888-4b59-a670-01bef7140005 req-90ae9c1b-3111-4c30-bc2c-7ba372d36d35 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] No waiting events found dispatching network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:25:14 user nova-compute[74959]: WARNING nova.compute.manager [req-c56e283b-a888-4b59-a670-01bef7140005 req-90ae9c1b-3111-4c30-bc2c-7ba372d36d35 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received unexpected event network-vif-plugged-ae0c9443-5386-4eab-ba2e-04736e978b70 for instance with vm_state active and task_state deleting.
Nov 28 23:25:14 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Took 0.51 seconds to deallocate network for instance.
Nov 28 23:25:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-bc7001de-6200-45cc-81d6-50b6fcc7de86 req-ee51e862-8e4b-4ce5-9928-2b769e3eb802 service nova] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Received event network-vif-deleted-ae0c9443-5386-4eab-ba2e-04736e978b70 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:15 user nova-compute[74959]: INFO nova.compute.manager [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Took 0.85 seconds to detach 1 volumes for instance.
Nov 28 23:25:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 2bcc967b-32fe-4dfa-9f74-670a3b10fb15] Deleting volume: 850e8564-a526-4764-b7e1-92eca698b5f7 {{(pid=74959) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 23:25:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:15 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:25:15 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:25:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:15 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Deleted allocations for instance 2bcc967b-32fe-4dfa-9f74-670a3b10fb15
Nov 28 23:25:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-a5101f76-9f44-43cc-9470-ce06574a6495 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "2bcc967b-32fe-4dfa-9f74-670a3b10fb15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.934s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:16 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Snapshot image upload complete
Nov 28 23:25:16 user nova-compute[74959]: INFO nova.compute.manager [None req-f76f48ae-5a6a-443d-9b49-8323228d244b tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Took 5.36 seconds to snapshot the instance on the hypervisor.
Nov 28 23:25:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:25:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:25:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:25:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:25:19 user nova-compute[74959]: INFO nova.compute.claims [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Claim successful on node user
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:25:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.policy [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76f0678a37a54084a10ef59450bf48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc33683ac964b16b2e8115112f7489b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:25:20 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Creating image(s)
Nov 28 23:25:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "/opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "/opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "/opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "caaacbf2ea7a61b2049aff12245d3d606fa66c3e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "caaacbf2ea7a61b2049aff12245d3d606fa66c3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e.part --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Successfully created port: 712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e.part --force-share --output=json" returned: 0 in 0.240s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG nova.virt.images [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] e92c42bd-f27a-4dfe-b681-0096d7dc6eb1 was qcow2, converting to raw {{(pid=74959) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG nova.privsep.utils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74959) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e.part /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e.converted {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e.part /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e.converted" returned: 0 in 0.235s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e.converted --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "caaacbf2ea7a61b2049aff12245d3d606fa66c3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.637s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Successfully updated port: 712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquired lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-a4b4401b-c829-4e30-b7a0-f0c063db56a7 req-cb0ed9cf-fbcf-4f55-b636-6dbd7237d83c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-changed-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-a4b4401b-c829-4e30-b7a0-f0c063db56a7 req-cb0ed9cf-fbcf-4f55-b636-6dbd7237d83c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Refreshing instance network info cache due to event network-changed-712cc154-754e-4a9e-b30f-eed422d7ece0. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a4b4401b-c829-4e30-b7a0-f0c063db56a7 req-cb0ed9cf-fbcf-4f55-b636-6dbd7237d83c service nova] Acquiring lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "caaacbf2ea7a61b2049aff12245d3d606fa66c3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "caaacbf2ea7a61b2049aff12245d3d606fa66c3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e,backing_fmt=raw /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e,backing_fmt=raw /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk 1073741824" returned: 0 in 0.068s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "caaacbf2ea7a61b2049aff12245d3d606fa66c3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updating instance_info_cache with network_info: [{"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Releasing lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Instance network_info: |[{"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a4b4401b-c829-4e30-b7a0-f0c063db56a7 req-cb0ed9cf-fbcf-4f55-b636-6dbd7237d83c service nova] Acquired lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.neutron [req-a4b4401b-c829-4e30-b7a0-f0c063db56a7 req-cb0ed9cf-fbcf-4f55-b636-6dbd7237d83c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Refreshing network info cache for port 712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Ensure instance console log exists: /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Start _get_guest_xml network_info=[{"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d3b2974c56b22bcb9853701cbc227b9b',container_format='bare',created_at=2023-11-28T23:25:11Z,direct_url=<?>,disk_format='qcow2',id=e92c42bd-f27a-4dfe-b681-0096d7dc6eb1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1244532158',owner='fcc33683ac964b16b2e8115112f7489b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T23:25:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'e92c42bd-f27a-4dfe-b681-0096d7dc6eb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:25:22 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:25:22 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d3b2974c56b22bcb9853701cbc227b9b',container_format='bare',created_at=2023-11-28T23:25:11Z,direct_url=<?>,disk_format='qcow2',id=e92c42bd-f27a-4dfe-b681-0096d7dc6eb1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1244532158',owner='fcc33683ac964b16b2e8115112f7489b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T23:25:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1662876389',display_name='tempest-TestStampPattern-server-1662876389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1662876389',id=45,image_ref='e92c42bd-f27a-4dfe-b681-0096d7dc6eb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4cOJf3ly2NvcASqmkADfhxKCfflwBu5oBowaFWrr/ngo6IFGpG8y1JHOAFnUs10K+hlInoVkZOf7OKgfcb+GDy0CADTfxxg4vsu+43PCPS+aote/8Pp0lrXLBlefKGNA==',key_name='tempest-TestStampPattern-807671422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc33683ac964b16b2e8115112f7489b',ramdisk_id='',reservation_id='r-5qppcaxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1effa435-b29a-424b-938a-2d5a2bb61853',image_min_disk='1',image_min_ram='0',image_owner_id='fcc33683ac964b16b2e8115112f7489b',image_owner_project_name='tempest-TestStampPattern-1559655051',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1559655051-project-member',image_user_id='76f0678a37a54084a10ef59450bf48ae',network_allocated='True',owner_project_name='tempest-TestStampPattern-1559655051',owner_user_name='tempest-TestStampPattern-1559655051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:25:20Z,user_data=None,user_id='76f0678a37a54084a10ef59450bf48ae',uuid=72955328-2f30-44a5-abe3-1d3014be72d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converting VIF {"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:7a:91,bridge_name='br-int',has_traffic_filtering=True,id=712cc154-754e-4a9e-b30f-eed422d7ece0,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712cc154-75') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'pci_devices' on Instance uuid 72955328-2f30-44a5-abe3-1d3014be72d6 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:25:22 user nova-compute[74959]:   <uuid>72955328-2f30-44a5-abe3-1d3014be72d6</uuid>
Nov 28 23:25:22 user nova-compute[74959]:   <name>instance-0000002d</name>
Nov 28 23:25:22 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:25:22 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:25:22 user nova-compute[74959]:   <metadata>
Nov 28 23:25:22 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:25:22 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:25:22 user nova-compute[74959]:       <nova:name>tempest-TestStampPattern-server-1662876389</nova:name>
Nov 28 23:25:22 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:25:22</nova:creationTime>
Nov 28 23:25:22 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:25:22 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:25:22 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:25:22 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:25:22 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:25:22 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:25:22 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:25:22 user nova-compute[74959]:       <nova:owner>
Nov 28 23:25:22 user nova-compute[74959]:         <nova:user uuid="76f0678a37a54084a10ef59450bf48ae">tempest-TestStampPattern-1559655051-project-member</nova:user>
Nov 28 23:25:22 user nova-compute[74959]:         <nova:project uuid="fcc33683ac964b16b2e8115112f7489b">tempest-TestStampPattern-1559655051</nova:project>
Nov 28 23:25:22 user nova-compute[74959]:       </nova:owner>
Nov 28 23:25:22 user nova-compute[74959]:       <nova:root type="image" uuid="e92c42bd-f27a-4dfe-b681-0096d7dc6eb1"/>
Nov 28 23:25:22 user nova-compute[74959]:       <nova:ports>
Nov 28 23:25:22 user nova-compute[74959]:         <nova:port uuid="712cc154-754e-4a9e-b30f-eed422d7ece0">
Nov 28 23:25:22 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 23:25:22 user nova-compute[74959]:         </nova:port>
Nov 28 23:25:22 user nova-compute[74959]:       </nova:ports>
Nov 28 23:25:22 user nova-compute[74959]:     </nova:instance>
Nov 28 23:25:22 user nova-compute[74959]:   </metadata>
Nov 28 23:25:22 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:25:22 user nova-compute[74959]:     <system>
Nov 28 23:25:22 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:25:22 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:25:22 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:25:22 user nova-compute[74959]:       <entry name="serial">72955328-2f30-44a5-abe3-1d3014be72d6</entry>
Nov 28 23:25:22 user nova-compute[74959]:       <entry name="uuid">72955328-2f30-44a5-abe3-1d3014be72d6</entry>
Nov 28 23:25:22 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:25:22 user nova-compute[74959]:     </system>
Nov 28 23:25:22 user nova-compute[74959]:   </sysinfo>
Nov 28 23:25:22 user nova-compute[74959]:   <os>
Nov 28 23:25:22 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:25:22 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:25:22 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:25:22 user nova-compute[74959]:   </os>
Nov 28 23:25:22 user nova-compute[74959]:   <features>
Nov 28 23:25:22 user nova-compute[74959]:     <acpi/>
Nov 28 23:25:22 user nova-compute[74959]:     <apic/>
Nov 28 23:25:22 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:25:22 user nova-compute[74959]:   </features>
Nov 28 23:25:22 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:25:22 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:25:22 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:25:22 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:25:22 user nova-compute[74959]:   </clock>
Nov 28 23:25:22 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:25:22 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:25:22 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:25:22 user nova-compute[74959]:   </cpu>
Nov 28 23:25:22 user nova-compute[74959]:   <devices>
Nov 28 23:25:22 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:25:22 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:25:22 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk"/>
Nov 28 23:25:22 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:25:22 user nova-compute[74959]:     </disk>
Nov 28 23:25:22 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:25:22 user nova-compute[74959]:       <mac address="fa:16:3e:e6:7a:91"/>
Nov 28 23:25:22 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:25:22 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:25:22 user nova-compute[74959]:       <target dev="tap712cc154-75"/>
Nov 28 23:25:22 user nova-compute[74959]:     </interface>
Nov 28 23:25:22 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:25:22 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/console.log" append="off"/>
Nov 28 23:25:22 user nova-compute[74959]:     </serial>
Nov 28 23:25:22 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:25:22 user nova-compute[74959]:     <video>
Nov 28 23:25:22 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:25:22 user nova-compute[74959]:     </video>
Nov 28 23:25:22 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:25:22 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:25:22 user nova-compute[74959]:     </rng>
Nov 28 23:25:22 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:25:22 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:25:22 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:25:22 user nova-compute[74959]:     </memballoon>
Nov 28 23:25:22 user nova-compute[74959]:   </devices>
Nov 28 23:25:22 user nova-compute[74959]: </domain>
Nov 28 23:25:22 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1662876389',display_name='tempest-TestStampPattern-server-1662876389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1662876389',id=45,image_ref='e92c42bd-f27a-4dfe-b681-0096d7dc6eb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4cOJf3ly2NvcASqmkADfhxKCfflwBu5oBowaFWrr/ngo6IFGpG8y1JHOAFnUs10K+hlInoVkZOf7OKgfcb+GDy0CADTfxxg4vsu+43PCPS+aote/8Pp0lrXLBlefKGNA==',key_name='tempest-TestStampPattern-807671422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc33683ac964b16b2e8115112f7489b',ramdisk_id='',reservation_id='r-5qppcaxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1effa435-b29a-424b-938a-2d5a2bb61853',image_min_disk='1',image_min_ram='0',image_owner_id='fcc33683ac964b16b2e8115112f7489b',image_owner_project_name='tempest-TestStampPattern-1559655051',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1559655051-project-member',image_user_id='76f0678a37a54084a10ef59450bf48ae',network_allocated='True',owner_project_name='tempest-TestStampPattern-1559655051',owner_user_name='tempest-TestStampPattern-1559655051-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:25:20Z,user_data=None,user_id='76f0678a37a54084a10ef59450bf48ae',uuid=72955328-2f30-44a5-abe3-1d3014be72d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converting VIF {"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:7a:91,bridge_name='br-int',has_traffic_filtering=True,id=712cc154-754e-4a9e-b30f-eed422d7ece0,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712cc154-75') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG os_vif [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:7a:91,bridge_name='br-int',has_traffic_filtering=True,id=712cc154-754e-4a9e-b30f-eed422d7ece0,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712cc154-75') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a84fc841-4791-5a91-9787-540601486c20', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap712cc154-75, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap712cc154-75, col_values=(('qos', UUID('c281845d-efdb-483f-91a8-9525f3454d8e')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap712cc154-75, col_values=(('external_ids', {'iface-id': '712cc154-754e-4a9e-b30f-eed422d7ece0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:7a:91', 'vm-uuid': '72955328-2f30-44a5-abe3-1d3014be72d6'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:22 user nova-compute[74959]: INFO os_vif [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:7a:91,bridge_name='br-int',has_traffic_filtering=True,id=712cc154-754e-4a9e-b30f-eed422d7ece0,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712cc154-75')
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No VIF found with MAC fa:16:3e:e6:7a:91, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.neutron [req-a4b4401b-c829-4e30-b7a0-f0c063db56a7 req-cb0ed9cf-fbcf-4f55-b636-6dbd7237d83c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updated VIF entry in instance network info cache for port 712cc154-754e-4a9e-b30f-eed422d7ece0. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG nova.network.neutron [req-a4b4401b-c829-4e30-b7a0-f0c063db56a7 req-cb0ed9cf-fbcf-4f55-b636-6dbd7237d83c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updating instance_info_cache with network_info: [{"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:25:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a4b4401b-c829-4e30-b7a0-f0c063db56a7 req-cb0ed9cf-fbcf-4f55-b636-6dbd7237d83c service nova] Releasing lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:25:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-4f57c167-5eda-40a2-be0f-d58a81039bde req-e789a4d1-797f-4f43-974f-629be0969c3b service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f57c167-5eda-40a2-be0f-d58a81039bde req-e789a4d1-797f-4f43-974f-629be0969c3b service nova] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f57c167-5eda-40a2-be0f-d58a81039bde req-e789a4d1-797f-4f43-974f-629be0969c3b service nova] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4f57c167-5eda-40a2-be0f-d58a81039bde req-e789a4d1-797f-4f43-974f-629be0969c3b service nova] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-4f57c167-5eda-40a2-be0f-d58a81039bde req-e789a4d1-797f-4f43-974f-629be0969c3b service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] No waiting events found dispatching network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:25:24 user nova-compute[74959]: WARNING nova.compute.manager [req-4f57c167-5eda-40a2-be0f-d58a81039bde req-e789a4d1-797f-4f43-974f-629be0969c3b service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received unexpected event network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 for instance with vm_state building and task_state spawning.
Nov 28 23:25:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-03985d35-9ac9-40fd-adf6-187f832760a7 req-7a1f3062-3323-4b39-8bf4-2bbb77f6486e service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received event network-changed-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-03985d35-9ac9-40fd-adf6-187f832760a7 req-7a1f3062-3323-4b39-8bf4-2bbb77f6486e service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Refreshing instance network info cache due to event network-changed-98a233b1-b9be-4afc-9d8a-3823a13942f0. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:25:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03985d35-9ac9-40fd-adf6-187f832760a7 req-7a1f3062-3323-4b39-8bf4-2bbb77f6486e service nova] Acquiring lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:25:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03985d35-9ac9-40fd-adf6-187f832760a7 req-7a1f3062-3323-4b39-8bf4-2bbb77f6486e service nova] Acquired lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:25:25 user nova-compute[74959]: DEBUG nova.network.neutron [req-03985d35-9ac9-40fd-adf6-187f832760a7 req-7a1f3062-3323-4b39-8bf4-2bbb77f6486e service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Refreshing network info cache for port 98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-03985d35-9ac9-40fd-adf6-187f832760a7 req-7a1f3062-3323-4b39-8bf4-2bbb77f6486e service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Updated VIF entry in instance network info cache for port 98a233b1-b9be-4afc-9d8a-3823a13942f0. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.network.neutron [req-03985d35-9ac9-40fd-adf6-187f832760a7 req-7a1f3062-3323-4b39-8bf4-2bbb77f6486e service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Updating instance_info_cache with network_info: [{"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03985d35-9ac9-40fd-adf6-187f832760a7 req-7a1f3062-3323-4b39-8bf4-2bbb77f6486e service nova] Releasing lock "refresh_cache-3a042cfb-b827-426f-af5f-e0b0afe62154" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:25:26 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Instance spawned successfully.
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:25:26 user nova-compute[74959]: INFO nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-df88bc8f-c972-47df-97b0-670cb665b94c req-80532c59-cbe1-4b31-ab98-690106bcad61 service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-df88bc8f-c972-47df-97b0-670cb665b94c req-80532c59-cbe1-4b31-ab98-690106bcad61 service nova] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-df88bc8f-c972-47df-97b0-670cb665b94c req-80532c59-cbe1-4b31-ab98-690106bcad61 service nova] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-df88bc8f-c972-47df-97b0-670cb665b94c req-80532c59-cbe1-4b31-ab98-690106bcad61 service nova] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-df88bc8f-c972-47df-97b0-670cb665b94c req-80532c59-cbe1-4b31-ab98-690106bcad61 service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] No waiting events found dispatching network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:25:26 user nova-compute[74959]: WARNING nova.compute.manager [req-df88bc8f-c972-47df-97b0-670cb665b94c req-80532c59-cbe1-4b31-ab98-690106bcad61 service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received unexpected event network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 for instance with vm_state building and task_state spawning.
Nov 28 23:25:26 user nova-compute[74959]: INFO nova.compute.manager [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Took 6.57 seconds to build instance.
Nov 28 23:25:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b0f62150-cbc6-4bcc-9056-32fcbffaae25 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.670s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG nova.objects.instance [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lazy-loading 'flavor' on Instance uuid 3a042cfb-b827-426f-af5f-e0b0afe62154 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:28 user nova-compute[74959]: INFO nova.compute.manager [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Attaching volume cb47e190-7cd9-4c11-9864-99aba6d244af to /dev/vdb
Nov 28 23:25:28 user nova-compute[74959]: DEBUG os_brick.utils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a84d551-491b-47c6-a6c7-07b61196f4c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f79783a-050c-434e-b20b-1d837eada170]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e733596-f94f-4a18-afda-19ba9ffca5c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b3f82e-23e7-4160-bddf-41d6cf12c5d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:25:29 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:25:29 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c4e02-6181-4afe-ac4b-fb5bf940cfdf]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG os_brick.utils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:25:29 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Updating existing volume attachment record: e2f42e91-cf7e-4313-bad4-9fe1ff14988d {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:30 user nova-compute[74959]: INFO nova.compute.manager [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Terminating instance
Nov 28 23:25:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Instance destroyed successfully.
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.objects.instance [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'resources' on Instance uuid 6533acac-8b30-4eb5-ba8f-16560e1d5af7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-4406d363-2434-44b8-a8c6-42f99d1916b4 req-c9e81b60-09f6-4aea-ae53-4cab9a4c0e6b service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-unplugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4406d363-2434-44b8-a8c6-42f99d1916b4 req-c9e81b60-09f6-4aea-ae53-4cab9a4c0e6b service nova] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4406d363-2434-44b8-a8c6-42f99d1916b4 req-c9e81b60-09f6-4aea-ae53-4cab9a4c0e6b service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-4406d363-2434-44b8-a8c6-42f99d1916b4 req-c9e81b60-09f6-4aea-ae53-4cab9a4c0e6b service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-4406d363-2434-44b8-a8c6-42f99d1916b4 req-c9e81b60-09f6-4aea-ae53-4cab9a4c0e6b service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] No waiting events found dispatching network-vif-unplugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-4406d363-2434-44b8-a8c6-42f99d1916b4 req-c9e81b60-09f6-4aea-ae53-4cab9a4c0e6b service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-unplugged-b3bc71e3-1363-4d17-bb0a-89df3579237f for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1289172084',display_name='tempest-ServerActionsTestOtherA-server-1289172084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1289172084',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:21:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-s1z8orwi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6533acac-8b30-4eb5-ba8f-16560e1d5af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "address": "fa:16:3e:b9:d3:c0", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc71e3-13", "ovs_interfaceid": "b3bc71e3-1363-4d17-bb0a-89df3579237f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_vif [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3bc71e3-13, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce2fa008-1a4c-4b3c-ab95-b66e96250e67) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:31 user nova-compute[74959]: INFO os_vif [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d3:c0,bridge_name='br-int',has_traffic_filtering=True,id=b3bc71e3-1363-4d17-bb0a-89df3579237f,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc71e3-13')
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKcEqOsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:25:31 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[367537d9-244c-4288-ae19-98c192c1136a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:25:31 user nova-compute[74959]: No targets found.
Nov 28 23:25:31 user nova-compute[74959]: iSNS:
Nov 28 23:25:31 user nova-compute[74959]: No targets found.
Nov 28 23:25:31 user nova-compute[74959]: STATIC:
Nov 28 23:25:31 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db
Nov 28 23:25:31 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:25:31 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:25:31 user nova-compute[74959]: FIRMWARE:
Nov 28 23:25:31 user nova-compute[74959]: No targets found.
Nov 28 23:25:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:25:31 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:25:31 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d679925-30a1-4e5f-b0ba-c0894b0f4445]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b956e201-84de-4071-91bc-0ae8595c63dc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:25:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db (non-flash)
Nov 28 23:25:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef478bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db'): ({'sdd'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Removing single pathed devices sdd {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a38c8-30d0-486b-ac5f-8f99ed5ed747]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d9236-f2df-4a0f-ac5f-5b8a1ce84b9b]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Flushing IO for device /dev/sdd {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04522e0-03fc-4b7c-a873-fa2c562ea483]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[454eeb7d-3dc8-4d53-86b3-ebe1215949e6]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] SCSI volumes sdd have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3b12a42b', '/dev/disk/by-id/scsi-1SCST_BIO3b12a42b-91e349517582ec82', '/dev/disk/by-id/scsi-23931653334393531') {{(pid=86637) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e4164e-1345-4638-884d-7bfff9e7868a]: (4, None) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022c5ab-b000-4b77-9696-d827ddf7174d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[220a12bc-5a75-42fa-9864-d1fbd60c18f1]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260]
Nov 28 23:25:31 user nova-compute[74959]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db, portal: 172.16.0.220,3260] successful.
Nov 28 23:25:31 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d26f5e53-5dd4-4660-94a5-5887fc2f85db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a9654-ea92-4710-ba91-1a32229b1739]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] <== disconnect_volume: return (380ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:25:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Deleting instance files /opt/stack/data/nova/instances/6533acac-8b30-4eb5-ba8f-16560e1d5af7_del
Nov 28 23:25:31 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Deletion of /opt/stack/data/nova/instances/6533acac-8b30-4eb5-ba8f-16560e1d5af7_del complete
Nov 28 23:25:31 user nova-compute[74959]: INFO nova.compute.manager [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 28 23:25:31 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:25:31 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:25:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:32 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:25:33 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Took 1.05 seconds to deallocate network for instance.
Nov 28 23:25:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-10082b21-4948-4002-9463-4e9a9d76cadc req-8c55ae3e-8092-41b0-b663-166fa36cbbc4 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-deleted-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-49b0ad72-958c-46c0-854b-f400561693db req-5b6f169a-6b11-4b7f-9d57-af3e60fb34d7 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:25:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-49b0ad72-958c-46c0-854b-f400561693db req-5b6f169a-6b11-4b7f-9d57-af3e60fb34d7 service nova] Acquiring lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-49b0ad72-958c-46c0-854b-f400561693db req-5b6f169a-6b11-4b7f-9d57-af3e60fb34d7 service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-49b0ad72-958c-46c0-854b-f400561693db req-5b6f169a-6b11-4b7f-9d57-af3e60fb34d7 service nova] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-49b0ad72-958c-46c0-854b-f400561693db req-5b6f169a-6b11-4b7f-9d57-af3e60fb34d7 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] No waiting events found dispatching network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:25:33 user nova-compute[74959]: WARNING nova.compute.manager [req-49b0ad72-958c-46c0-854b-f400561693db req-5b6f169a-6b11-4b7f-9d57-af3e60fb34d7 service nova] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Received unexpected event network-vif-plugged-b3bc71e3-1363-4d17-bb0a-89df3579237f for instance with vm_state active and task_state deleting.
Nov 28 23:25:33 user nova-compute[74959]: INFO nova.compute.manager [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Took 0.91 seconds to detach 1 volumes for instance.
Nov 28 23:25:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6533acac-8b30-4eb5-ba8f-16560e1d5af7] Deleting volume: d26f5e53-5dd4-4660-94a5-5887fc2f85db {{(pid=74959) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 23:25:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:25:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:25:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:34 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Deleted allocations for instance 6533acac-8b30-4eb5-ba8f-16560e1d5af7
Nov 28 23:25:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-5daa5c2e-e134-41ea-a9ae-7301d01b2959 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6533acac-8b30-4eb5-ba8f-16560e1d5af7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.805s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrXRYxVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:25:36 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:25:36 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:25:36 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c5e7bf-e0a2-4edf-8215-4f4f3cb48bbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:25:36 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a4c01f-19df-4ea5-aced-e0c5499b4451]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af] added
Nov 28 23:25:36 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a721a03-d8da-48a9-90b9-6b699ab2269c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba59dc06-f570-446a-85ac-650df2161c40]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrXRYxVl {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrXRYxVl" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1158cada-689f-4827-8f3b-bccf3bd788b0]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jrXRYxVl'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cada50c3-2cc0-4ac7-88a0-6317edc83768]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efdcdcf-daab-42f4-b02e-345a99676684]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:25:36 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:25:36 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:25:36 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:25:36 user nova-compute[74959]: 
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5f7504-0fea-4415-ac8e-e98d461f2d77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af, portal: 172.16.0.220,3260]
Nov 28 23:25:36 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af, portal: 172.16.0.220,3260] successful.
Nov 28 23:25:36 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47cd41c-35e6-4900-8c47-1a589a9fbdde]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c0864-b73b-439d-9ce2-1fc78f48060d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af (non-flash)
Nov 28 23:25:36 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af (non-flash)
Nov 28 23:25:36 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479d8a1-08e5-447b-9250-3302f769135e]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:25:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrXRYxVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:25:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:25:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23363343235396463', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:25:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363343235396463', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:25:37 user nova-compute[74959]: DEBUG nova.objects.instance [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lazy-loading 'flavor' on Instance uuid 3a042cfb-b827-426f-af5f-e0b0afe62154 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:25:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:25:37 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:25:37 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:25:37 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:25:37 user nova-compute[74959]:   <serial>cb47e190-7cd9-4c11-9864-99aba6d244af</serial>
Nov 28 23:25:37 user nova-compute[74959]: </disk>
Nov 28 23:25:37 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:25:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:25:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:25:38 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] No VIF found with MAC fa:16:3e:56:25:d6, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:25:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-00bfe09c-b409-4668-b3e6-66293f19cd6b tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.360s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:25:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:25:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:25:39 user nova-compute[74959]: INFO nova.compute.manager [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Detaching volume cb47e190-7cd9-4c11-9864-99aba6d244af
Nov 28 23:25:39 user nova-compute[74959]: INFO nova.virt.block_device [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Attempting to driver detach volume cb47e190-7cd9-4c11-9864-99aba6d244af from mountpoint /dev/vdb
Nov 28 23:25:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Attempting to detach device vdb from instance 3a042cfb-b827-426f-af5f-e0b0afe62154 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:25:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:25:39 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:25:39 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:25:39 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:25:39 user nova-compute[74959]:   <serial>cb47e190-7cd9-4c11-9864-99aba6d244af</serial>
Nov 28 23:25:39 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:25:39 user nova-compute[74959]: </disk>
Nov 28 23:25:39 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:25:39 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Successfully detached device vdb from instance 3a042cfb-b827-426f-af5f-e0b0afe62154 from the persistent domain config.
Nov 28 23:25:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a042cfb-b827-426f-af5f-e0b0afe62154 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:25:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:25:39 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:25:39 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:25:39 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:25:39 user nova-compute[74959]:   <serial>cb47e190-7cd9-4c11-9864-99aba6d244af</serial>
Nov 28 23:25:39 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:25:39 user nova-compute[74959]: </disk>
Nov 28 23:25:39 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:25:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a042cfb-b827-426f-af5f-e0b0afe62154 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:25:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:25:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:25:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:25:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:25:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:25:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:25:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:25:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 6a4c9cc3-e1c2-4963-8848-d52db32ae85e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:25:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updating instance_info_cache with network_info: [{"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:25:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-6a4c9cc3-e1c2-4963-8848-d52db32ae85e" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:25:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:25:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:25:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:00 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a042cfb-b827-426f-af5f-e0b0afe62154 is timed out.
Nov 28 23:26:00 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Successfully detached device vdb from instance 3a042cfb-b827-426f-af5f-e0b0afe62154 from the live domain config.
Nov 28 23:26:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrXRYxVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:26:00 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba9e11b-40cb-43ff-a4e3-e3f0daf9943c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:26:00 user nova-compute[74959]: No targets found.
Nov 28 23:26:00 user nova-compute[74959]: iSNS:
Nov 28 23:26:00 user nova-compute[74959]: No targets found.
Nov 28 23:26:00 user nova-compute[74959]: STATIC:
Nov 28 23:26:00 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af
Nov 28 23:26:00 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:26:00 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:26:00 user nova-compute[74959]: FIRMWARE:
Nov 28 23:26:00 user nova-compute[74959]: No targets found.
Nov 28 23:26:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:26:00 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:26:00 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e54107-ae70-4819-a739-2b8aecd25d7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcc7e11-2feb-4450-b576-8b253e5f70ec]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af (non-flash)
Nov 28 23:26:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af (non-flash)
Nov 28 23:26:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4741510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e6059c-69e7-4d0a-b474-d9c0c22ec18c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f0da0-ff6e-43b3-b16a-0be727c469c6]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84e8ae1-8fa3-429e-a4f7-43afc6cdfeee]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a040b97-d198-4e81-9988-f1505ae1a9d2]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[577b5aff-48c6-4c61-97d2-d975fe4b7183]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcdd97c-e191-4557-8f91-c19ff3609d12]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af, portal: 172.16.0.220,3260]
Nov 28 23:26:00 user nova-compute[74959]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af, portal: 172.16.0.220,3260] successful.
Nov 28 23:26:00 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb47e190-7cd9-4c11-9864-99aba6d244af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0747d0d-0775-41d1-9abe-5df2d4470987]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] <== disconnect_volume: return (278ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:26:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lazy-loading 'flavor' on Instance uuid 3a042cfb-b827-426f-af5f-e0b0afe62154 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:26:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-ceb53ed1-9453-4ef8-b642-d529402d6dde tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.769s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:26:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=24.980083465576172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 1effa435-b29a-424b-938a-2d5a2bb61853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 3a042cfb-b827-426f-af5f-e0b0afe62154 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 72955328-2f30-44a5-abe3-1d3014be72d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:26:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:26:16 user nova-compute[74959]: INFO nova.compute.claims [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Claim successful on node user
Nov 28 23:26:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:26:16 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG nova.policy [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '762e77e638ee4789a04c58868648d0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b91fdb847ce9aefc26052b7e87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:26:16 user nova-compute[74959]: INFO nova.virt.block_device [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Booting with volume e0cb5a36-04ed-449b-b8f0-aa2472160d77 at /dev/vda
Nov 28 23:26:16 user nova-compute[74959]: DEBUG os_brick.utils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6549f0c-c2c2-4da1-a4b3-7e7caf1a6eee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e498764-2faf-4cee-9613-e741c474aaed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9822f3b-9671-43b0-bcab-38919757dba1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef835f1-75be-4bf3-a78b-a9e472102f3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:26:17 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c7d95-668c-47b1-b840-3adbb0168b55]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG os_brick.utils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updating existing volume attachment record: d141e41e-1bfb-4ad5-81b3-1557973015d1 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Successfully created port: 5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:17 user nova-compute[74959]: WARNING nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Nov 28 23:26:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 6a4c9cc3-e1c2-4963-8848-d52db32ae85e {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 1effa435-b29a-424b-938a-2d5a2bb61853 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 3a042cfb-b827-426f-af5f-e0b0afe62154 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 72955328-2f30-44a5-abe3-1d3014be72d6 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 37863cc3-07b2-4787-9b7b-ad122bac0f05 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Successfully updated port: 5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquired lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-e2bfb292-8763-4e18-871c-48c7e03d6002 req-e4f4dbde-7a1a-48ef-a7cb-ca6ecdb61960 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received event network-changed-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-e2bfb292-8763-4e18-871c-48c7e03d6002 req-e4f4dbde-7a1a-48ef-a7cb-ca6ecdb61960 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Refreshing instance network info cache due to event network-changed-5ccc77c2-c3bc-42cf-9a43-facccffec089. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e2bfb292-8763-4e18-871c-48c7e03d6002 req-e4f4dbde-7a1a-48ef-a7cb-ca6ecdb61960 service nova] Acquiring lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updating instance_info_cache with network_info: [{"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Releasing lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Instance network_info: |[{"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e2bfb292-8763-4e18-871c-48c7e03d6002 req-e4f4dbde-7a1a-48ef-a7cb-ca6ecdb61960 service nova] Acquired lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-e2bfb292-8763-4e18-871c-48c7e03d6002 req-e4f4dbde-7a1a-48ef-a7cb-ca6ecdb61960 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Refreshing network info cache for port 5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-e2bfb292-8763-4e18-871c-48c7e03d6002 req-e4f4dbde-7a1a-48ef-a7cb-ca6ecdb61960 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updated VIF entry in instance network info cache for port 5ccc77c2-c3bc-42cf-9a43-facccffec089. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-e2bfb292-8763-4e18-871c-48c7e03d6002 req-e4f4dbde-7a1a-48ef-a7cb-ca6ecdb61960 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updating instance_info_cache with network_info: [{"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:26:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e2bfb292-8763-4e18-871c-48c7e03d6002 req-e4f4dbde-7a1a-48ef-a7cb-ca6ecdb61960 service nova] Releasing lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:26:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:26:24 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Creating image(s)
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Ensure instance console log exists: /opt/stack/data/nova/instances/37863cc3-07b2-4787-9b7b-ad122bac0f05/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Start _get_guest_xml network_info=[{"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVrHlSZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37863cc3-07b2-4787-9b7b-ad122bac0f05', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0cb5a36-04ed-449b-b8f0-aa2472160d77', 'serial': 'e0cb5a36-04ed-449b-b8f0-aa2472160d77'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'd141e41e-1bfb-4ad5-81b3-1557973015d1', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:26:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:26:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVrHlSZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:26:24 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:26:24 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:26:24 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[782069aa-21a4-4b55-bc0c-0a8e8aaf22ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:26:24 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[20de5163-c6e7-48b4-a89b-69bd9e022e39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77] added
Nov 28 23:26:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1ace24-8792-4104-8ff8-c69864b8a111]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae79c602-4879-4fc8-84fd-e6539a7417d6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVrHlSZu {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVrHlSZu" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[817ca0d2-e77d-402f-b545-3e54feaf355d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LVrHlSZu'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[39154a49-e12b-4447-8067-1d86e45901c1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[03173db5-df7c-446a-8b6d-84a2448a0b18]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:26:24 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:26:24 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:26:24 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:26:24 user nova-compute[74959]: 
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfda842-7976-403c-806a-9e4002bfbb28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77, portal: 172.16.0.220,3260]
Nov 28 23:26:24 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77, portal: 172.16.0.220,3260] successful.
Nov 28 23:26:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[344ef172-b805-4d5f-98cd-970086a13c2d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2672aa38-d353-4dee-81d6-2c4e2ca76545]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:26:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:26:24 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1196f38d-1431-421a-b328-c63d08611d60]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVrHlSZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:24 user nova-compute[74959]: INFO nova.compute.manager [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Terminating instance
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-ec77a542-2c86-435c-a74f-c19792f83090 req-901762ea-2b33-4274-98b6-5880fcf44f65 service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-unplugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ec77a542-2c86-435c-a74f-c19792f83090 req-901762ea-2b33-4274-98b6-5880fcf44f65 service nova] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ec77a542-2c86-435c-a74f-c19792f83090 req-901762ea-2b33-4274-98b6-5880fcf44f65 service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ec77a542-2c86-435c-a74f-c19792f83090 req-901762ea-2b33-4274-98b6-5880fcf44f65 service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-ec77a542-2c86-435c-a74f-c19792f83090 req-901762ea-2b33-4274-98b6-5880fcf44f65 service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] No waiting events found dispatching network-vif-unplugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:24 user nova-compute[74959]: DEBUG nova.compute.manager [req-ec77a542-2c86-435c-a74f-c19792f83090 req-901762ea-2b33-4274-98b6-5880fcf44f65 service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-unplugged-72a7bc36-1b60-4142-885f-33c78bb17209 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Instance destroyed successfully.
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.objects.instance [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lazy-loading 'resources' on Instance uuid 6a4c9cc3-e1c2-4963-8848-d52db32ae85e {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1271745554',display_name='tempest-ServerActionsTestOtherA-server-1271745554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1271745554',id=25,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6j6JbGR/MKzF+8Bs5jou9KSpMd2P8AVmfRm+zqdJxD5gJN6chBxZL8qOi4ptLGbhjYwCnkZef6/hrC277yBNoRTBldVimZu2DaOjq4nlHGfVdiFIJf3RK2pfI5pYo9bA==',key_name='tempest-keypair-899916368',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ac0d1f399f040f98098e84ac875c1fd',ramdisk_id='',reservation_id='r-wzcemom4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2143945835',owner_user_name='tempest-ServerActionsTestOtherA-2143945835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:07:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73af90e11a374c9cbf0a58db8410e245',uuid=6a4c9cc3-e1c2-4963-8848-d52db32ae85e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converting VIF {"id": "72a7bc36-1b60-4142-885f-33c78bb17209", "address": "fa:16:3e:92:70:ec", "network": {"id": "fa344739-9b54-45af-9cd2-b2170b9881f0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-651875965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ac0d1f399f040f98098e84ac875c1fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a7bc36-1b", "ovs_interfaceid": "72a7bc36-1b60-4142-885f-33c78bb17209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:ec,bridge_name='br-int',has_traffic_filtering=True,id=72a7bc36-1b60-4142-885f-33c78bb17209,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a7bc36-1b') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG os_vif [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:ec,bridge_name='br-int',has_traffic_filtering=True,id=72a7bc36-1b60-4142-885f-33c78bb17209,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a7bc36-1b') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a7bc36-1b, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35580598-982b-4c41-b669-a5399b4fa1c5) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:26:25 user nova-compute[74959]: INFO os_vif [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:70:ec,bridge_name='br-int',has_traffic_filtering=True,id=72a7bc36-1b60-4142-885f-33c78bb17209,network=Network(fa344739-9b54-45af-9cd2-b2170b9881f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a7bc36-1b')
Nov 28 23:26:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Deleting instance files /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e_del
Nov 28 23:26:25 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Deletion of /opt/stack/data/nova/instances/6a4c9cc3-e1c2-4963-8848-d52db32ae85e_del complete
Nov 28 23:26:25 user nova-compute[74959]: INFO nova.compute.manager [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 28 23:26:25 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26235356661323030', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235356661323030', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1750471763',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1750471763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1750471763',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNsQtARnSmSUrFuP7QdzTSTW7m7bngXgZTqK2FiOWvnbeboE9gYPpp73ESDjmB3PviHLh58DGtFElaOLTgHcuwbyEl1/wBN1TUizqaWqcElhlRVsZA9EN30a3P8r61zSA==',key_name='tempest-keypair-163764882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-j22hve09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:26:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='762e77e638ee4789a04c58868648d0a0',uuid=37863cc3-07b2-4787-9b7b-ad122bac0f05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:31:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc77c2-c3bc-42cf-9a43-facccffec089,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc77c2-c3') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.objects.instance [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'pci_devices' on Instance uuid 37863cc3-07b2-4787-9b7b-ad122bac0f05 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:26:25 user nova-compute[74959]:   <uuid>37863cc3-07b2-4787-9b7b-ad122bac0f05</uuid>
Nov 28 23:26:25 user nova-compute[74959]:   <name>instance-0000002e</name>
Nov 28 23:26:25 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:26:25 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:26:25 user nova-compute[74959]:   <metadata>
Nov 28 23:26:25 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:26:25 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:26:25 user nova-compute[74959]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1750471763</nova:name>
Nov 28 23:26:25 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:26:24</nova:creationTime>
Nov 28 23:26:25 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:26:25 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:26:25 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:26:25 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:26:25 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:26:25 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:26:25 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:26:25 user nova-compute[74959]:       <nova:owner>
Nov 28 23:26:25 user nova-compute[74959]:         <nova:user uuid="762e77e638ee4789a04c58868648d0a0">tempest-TestVolumeBootPattern-1296185511-project-member</nova:user>
Nov 28 23:26:25 user nova-compute[74959]:         <nova:project uuid="1e1c6b91fdb847ce9aefc26052b7e87c">tempest-TestVolumeBootPattern-1296185511</nova:project>
Nov 28 23:26:25 user nova-compute[74959]:       </nova:owner>
Nov 28 23:26:25 user nova-compute[74959]:       <nova:ports>
Nov 28 23:26:25 user nova-compute[74959]:         <nova:port uuid="5ccc77c2-c3bc-42cf-9a43-facccffec089">
Nov 28 23:26:25 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 23:26:25 user nova-compute[74959]:         </nova:port>
Nov 28 23:26:25 user nova-compute[74959]:       </nova:ports>
Nov 28 23:26:25 user nova-compute[74959]:     </nova:instance>
Nov 28 23:26:25 user nova-compute[74959]:   </metadata>
Nov 28 23:26:25 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:26:25 user nova-compute[74959]:     <system>
Nov 28 23:26:25 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:26:25 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:26:25 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:26:25 user nova-compute[74959]:       <entry name="serial">37863cc3-07b2-4787-9b7b-ad122bac0f05</entry>
Nov 28 23:26:25 user nova-compute[74959]:       <entry name="uuid">37863cc3-07b2-4787-9b7b-ad122bac0f05</entry>
Nov 28 23:26:25 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:26:25 user nova-compute[74959]:     </system>
Nov 28 23:26:25 user nova-compute[74959]:   </sysinfo>
Nov 28 23:26:25 user nova-compute[74959]:   <os>
Nov 28 23:26:25 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:26:25 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:26:25 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:26:25 user nova-compute[74959]:   </os>
Nov 28 23:26:25 user nova-compute[74959]:   <features>
Nov 28 23:26:25 user nova-compute[74959]:     <acpi/>
Nov 28 23:26:25 user nova-compute[74959]:     <apic/>
Nov 28 23:26:25 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:26:25 user nova-compute[74959]:   </features>
Nov 28 23:26:25 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:26:25 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:26:25 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:26:25 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:26:25 user nova-compute[74959]:   </clock>
Nov 28 23:26:25 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:26:25 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:26:25 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:26:25 user nova-compute[74959]:   </cpu>
Nov 28 23:26:25 user nova-compute[74959]:   <devices>
Nov 28 23:26:25 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:26:25 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:26:25 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:26:25 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:26:25 user nova-compute[74959]:       <serial>e0cb5a36-04ed-449b-b8f0-aa2472160d77</serial>
Nov 28 23:26:25 user nova-compute[74959]:     </disk>
Nov 28 23:26:25 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:26:25 user nova-compute[74959]:       <mac address="fa:16:3e:c5:31:d7"/>
Nov 28 23:26:25 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:26:25 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:26:25 user nova-compute[74959]:       <target dev="tap5ccc77c2-c3"/>
Nov 28 23:26:25 user nova-compute[74959]:     </interface>
Nov 28 23:26:25 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:26:25 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/37863cc3-07b2-4787-9b7b-ad122bac0f05/console.log" append="off"/>
Nov 28 23:26:25 user nova-compute[74959]:     </serial>
Nov 28 23:26:25 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:26:25 user nova-compute[74959]:     <video>
Nov 28 23:26:25 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:26:25 user nova-compute[74959]:     </video>
Nov 28 23:26:25 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:26:25 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:26:25 user nova-compute[74959]:     </rng>
Nov 28 23:26:25 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:26:25 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:26:25 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:26:25 user nova-compute[74959]:     </memballoon>
Nov 28 23:26:25 user nova-compute[74959]:   </devices>
Nov 28 23:26:25 user nova-compute[74959]: </domain>
Nov 28 23:26:25 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1750471763',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1750471763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1750471763',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNsQtARnSmSUrFuP7QdzTSTW7m7bngXgZTqK2FiOWvnbeboE9gYPpp73ESDjmB3PviHLh58DGtFElaOLTgHcuwbyEl1/wBN1TUizqaWqcElhlRVsZA9EN30a3P8r61zSA==',key_name='tempest-keypair-163764882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-j22hve09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:26:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='762e77e638ee4789a04c58868648d0a0',uuid=37863cc3-07b2-4787-9b7b-ad122bac0f05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:31:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc77c2-c3bc-42cf-9a43-facccffec089,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc77c2-c3') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG os_vif [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:31:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc77c2-c3bc-42cf-9a43-facccffec089,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc77c2-c3') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac09104b-0e0c-595d-8e4a-821108762fb7', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccc77c2-c3, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ccc77c2-c3, col_values=(('qos', UUID('90925e0e-f0a3-44f9-b2ff-1316770b499d')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ccc77c2-c3, col_values=(('external_ids', {'iface-id': '5ccc77c2-c3bc-42cf-9a43-facccffec089', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:31:d7', 'vm-uuid': '37863cc3-07b2-4787-9b7b-ad122bac0f05'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: INFO os_vif [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:31:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc77c2-c3bc-42cf-9a43-facccffec089,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc77c2-c3')
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No VIF found with MAC fa:16:3e:c5:31:d7, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:26:25 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Took 0.65 seconds to deallocate network for instance.
Nov 28 23:26:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-e0896c77-8e66-4a30-8518-a6bc84ff3357 req-d49d4def-3560-4b85-ba12-86955f8791d3 service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-deleted-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:26 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Deleted allocations for instance 6a4c9cc3-e1c2-4963-8848-d52db32ae85e
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4f131b42-cfee-49a3-9fab-dd7e55206134 tempest-ServerActionsTestOtherA-2143945835 tempest-ServerActionsTestOtherA-2143945835-project-member] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.807s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] No waiting events found dispatching network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:26 user nova-compute[74959]: WARNING nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received unexpected event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 for instance with vm_state deleted and task_state None.
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] No waiting events found dispatching network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:26 user nova-compute[74959]: WARNING nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received unexpected event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 for instance with vm_state deleted and task_state None.
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] No waiting events found dispatching network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:26 user nova-compute[74959]: WARNING nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received unexpected event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 for instance with vm_state deleted and task_state None.
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-unplugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] No waiting events found dispatching network-vif-unplugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:26 user nova-compute[74959]: WARNING nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received unexpected event network-vif-unplugged-72a7bc36-1b60-4142-885f-33c78bb17209 for instance with vm_state deleted and task_state None.
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Acquiring lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] Lock "6a4c9cc3-e1c2-4963-8848-d52db32ae85e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:26 user nova-compute[74959]: DEBUG nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] No waiting events found dispatching network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:26 user nova-compute[74959]: WARNING nova.compute.manager [req-b2422d91-be65-4be5-bbeb-36d1fa2961d3 req-2db39a48-dede-4a0d-822b-e150d2102a9f service nova] [instance: 6a4c9cc3-e1c2-4963-8848-d52db32ae85e] Received unexpected event network-vif-plugged-72a7bc36-1b60-4142-885f-33c78bb17209 for instance with vm_state deleted and task_state None.
Nov 28 23:26:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received event network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] Acquiring lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] No waiting events found dispatching network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:28 user nova-compute[74959]: WARNING nova.compute.manager [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received unexpected event network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 for instance with vm_state building and task_state spawning.
Nov 28 23:26:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received event network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] Acquiring lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] No waiting events found dispatching network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:28 user nova-compute[74959]: WARNING nova.compute.manager [req-03ef3e18-1e1e-4053-ae48-1e5181883ea8 req-44a9b36c-5a16-43c7-8a76-ccace0974687 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received unexpected event network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 for instance with vm_state building and task_state spawning.
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:26:29 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Instance spawned successfully.
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:26:29 user nova-compute[74959]: INFO nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 28 23:26:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:26:29 user nova-compute[74959]: INFO nova.compute.manager [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Took 12.79 seconds to build instance.
Nov 28 23:26:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-e5682630-d0e0-49c4-9dc0-ebf9650eeef0 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.888s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.549s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:29 user nova-compute[74959]: INFO nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 28 23:26:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:33 user nova-compute[74959]: INFO nova.compute.manager [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Terminating instance
Nov 28 23:26:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-63439e07-3428-431a-9a40-bd2cbffdd99f req-81cfbe7e-3550-4f41-b60d-8157dda9725c service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received event network-vif-unplugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-63439e07-3428-431a-9a40-bd2cbffdd99f req-81cfbe7e-3550-4f41-b60d-8157dda9725c service nova] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-63439e07-3428-431a-9a40-bd2cbffdd99f req-81cfbe7e-3550-4f41-b60d-8157dda9725c service nova] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-63439e07-3428-431a-9a40-bd2cbffdd99f req-81cfbe7e-3550-4f41-b60d-8157dda9725c service nova] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-63439e07-3428-431a-9a40-bd2cbffdd99f req-81cfbe7e-3550-4f41-b60d-8157dda9725c service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] No waiting events found dispatching network-vif-unplugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-63439e07-3428-431a-9a40-bd2cbffdd99f req-81cfbe7e-3550-4f41-b60d-8157dda9725c service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received event network-vif-unplugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Instance destroyed successfully.
Nov 28 23:26:34 user nova-compute[74959]: DEBUG nova.objects.instance [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lazy-loading 'resources' on Instance uuid 3a042cfb-b827-426f-af5f-e0b0afe62154 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-87466378',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-87466378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8746637',id=44,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPug8/LVdOTkfbpU/QFKTqNm8YjA8sOxz1GSvZKv0ogBwBXyMNYR00OosOtgUBWywbAfPxQpSJvXaETM+8NyY0OZ6AgydxQhG35anO1bddgWGer5ySHTC4GnyRJMnBPA4g==',key_name='tempest-keypair-981411389',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:23:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5559dee7c82847318eacecc9d1a8d644',ramdisk_id='',reservation_id='r-6r8z38fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1195099830',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:23:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f35aecf9a8247f58850821ae0e5db67',uuid=3a042cfb-b827-426f-af5f-e0b0afe62154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Converting VIF {"id": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "address": "fa:16:3e:56:25:d6", "network": {"id": "e1316cf1-6b60-4a95-a804-a151c36f999c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1237922284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5559dee7c82847318eacecc9d1a8d644", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a233b1-b9", "ovs_interfaceid": "98a233b1-b9be-4afc-9d8a-3823a13942f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:25:d6,bridge_name='br-int',has_traffic_filtering=True,id=98a233b1-b9be-4afc-9d8a-3823a13942f0,network=Network(e1316cf1-6b60-4a95-a804-a151c36f999c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a233b1-b9') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG os_vif [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:25:d6,bridge_name='br-int',has_traffic_filtering=True,id=98a233b1-b9be-4afc-9d8a-3823a13942f0,network=Network(e1316cf1-6b60-4a95-a804-a151c36f999c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a233b1-b9') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98a233b1-b9, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0712804b-5078-4243-ac16-fec68e1960f8) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:34 user nova-compute[74959]: INFO os_vif [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:25:d6,bridge_name='br-int',has_traffic_filtering=True,id=98a233b1-b9be-4afc-9d8a-3823a13942f0,network=Network(e1316cf1-6b60-4a95-a804-a151c36f999c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98a233b1-b9')
Nov 28 23:26:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Deleting instance files /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154_del
Nov 28 23:26:34 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Deletion of /opt/stack/data/nova/instances/3a042cfb-b827-426f-af5f-e0b0afe62154_del complete
Nov 28 23:26:34 user nova-compute[74959]: INFO nova.compute.manager [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 23:26:34 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:26:34 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:26:35 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Took 0.91 seconds to deallocate network for instance.
Nov 28 23:26:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:35 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Deleted allocations for instance 3a042cfb-b827-426f-af5f-e0b0afe62154
Nov 28 23:26:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-057d035a-b8e8-41ed-b4ba-feb6d0a38b31 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830 tempest-TestServerVolumeAttachScenarioOldVersion-1195099830-project-member] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.245s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-de9547f1-2275-4f36-8439-45befefe5f7b req-0a36b7ea-0f69-47b8-8daf-ce902ec7f0db service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received event network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-de9547f1-2275-4f36-8439-45befefe5f7b req-0a36b7ea-0f69-47b8-8daf-ce902ec7f0db service nova] Acquiring lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-de9547f1-2275-4f36-8439-45befefe5f7b req-0a36b7ea-0f69-47b8-8daf-ce902ec7f0db service nova] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-de9547f1-2275-4f36-8439-45befefe5f7b req-0a36b7ea-0f69-47b8-8daf-ce902ec7f0db service nova] Lock "3a042cfb-b827-426f-af5f-e0b0afe62154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:26:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-de9547f1-2275-4f36-8439-45befefe5f7b req-0a36b7ea-0f69-47b8-8daf-ce902ec7f0db service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] No waiting events found dispatching network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:26:35 user nova-compute[74959]: WARNING nova.compute.manager [req-de9547f1-2275-4f36-8439-45befefe5f7b req-0a36b7ea-0f69-47b8-8daf-ce902ec7f0db service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received unexpected event network-vif-plugged-98a233b1-b9be-4afc-9d8a-3823a13942f0 for instance with vm_state deleted and task_state None.
Nov 28 23:26:35 user nova-compute[74959]: DEBUG nova.compute.manager [req-de9547f1-2275-4f36-8439-45befefe5f7b req-0a36b7ea-0f69-47b8-8daf-ce902ec7f0db service nova] [instance: 3a042cfb-b827-426f-af5f-e0b0afe62154] Received event network-vif-deleted-98a233b1-b9be-4afc-9d8a-3823a13942f0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:26:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:26:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:26:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:26:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:26:54 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:26:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating instance_info_cache with network_info: [{"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:26:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:26:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:26:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:26:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:26:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:27:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:27:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:27:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.02539825439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 1effa435-b29a-424b-938a-2d5a2bb61853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 72955328-2f30-44a5-abe3-1d3014be72d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 37863cc3-07b2-4787-9b7b-ad122bac0f05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:27:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:27:08 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:27:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:27:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:27:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:27:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-5cf6bbd0-d489-48d5-bdc9-f1ef0a2e3c5d req-fe73ed8b-9ff2-472f-95d0-9891b2df100c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-changed-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:27:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-5cf6bbd0-d489-48d5-bdc9-f1ef0a2e3c5d req-fe73ed8b-9ff2-472f-95d0-9891b2df100c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Refreshing instance network info cache due to event network-changed-712cc154-754e-4a9e-b30f-eed422d7ece0. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:27:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5cf6bbd0-d489-48d5-bdc9-f1ef0a2e3c5d req-fe73ed8b-9ff2-472f-95d0-9891b2df100c service nova] Acquiring lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:27:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5cf6bbd0-d489-48d5-bdc9-f1ef0a2e3c5d req-fe73ed8b-9ff2-472f-95d0-9891b2df100c service nova] Acquired lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:27:11 user nova-compute[74959]: DEBUG nova.network.neutron [req-5cf6bbd0-d489-48d5-bdc9-f1ef0a2e3c5d req-fe73ed8b-9ff2-472f-95d0-9891b2df100c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Refreshing network info cache for port 712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-5cf6bbd0-d489-48d5-bdc9-f1ef0a2e3c5d req-fe73ed8b-9ff2-472f-95d0-9891b2df100c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updated VIF entry in instance network info cache for port 712cc154-754e-4a9e-b30f-eed422d7ece0. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-5cf6bbd0-d489-48d5-bdc9-f1ef0a2e3c5d req-fe73ed8b-9ff2-472f-95d0-9891b2df100c service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updating instance_info_cache with network_info: [{"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5cf6bbd0-d489-48d5-bdc9-f1ef0a2e3c5d req-fe73ed8b-9ff2-472f-95d0-9891b2df100c service nova] Releasing lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG nova.objects.instance [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'flavor' on Instance uuid 72955328-2f30-44a5-abe3-1d3014be72d6 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:12 user nova-compute[74959]: INFO nova.compute.manager [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Attaching volume 63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 to /dev/vdb
Nov 28 23:27:12 user nova-compute[74959]: DEBUG os_brick.utils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f53e1c5-3033-4b9f-887a-9c20f1c995fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[576b0b60-9779-48e2-bf38-f85106d5ca7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef548a21-076d-40c3-a8cb-3e5cc6e20e48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a36b34-b29d-4fc6-ae0c-e1eb34ebb561]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:27:12 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:27:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04d5523-1342-4995-a596-f36388a66b25]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG os_brick.utils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:27:12 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updating existing volume attachment record: 2db98faa-04ad-476c-a91e-4b8a38c5b190 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:27:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOpSjZAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:27:19 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:27:19 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:27:19 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cdca86-46a9-4bf5-b373-9de8b113c473]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:27:19 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af40f15-e8c3-4d09-8276-eea1875abdaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9] added
Nov 28 23:27:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbfb5e2-b43b-461e-82d6-f679b8b04809]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a625e157-72a3-4f50-bb87-ae95589f6afb]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOpSjZAm {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOpSjZAm" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c727e-1ea4-4306-b9d7-3264e9a97788]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hOpSjZAm'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[18870672-07a9-4b08-b0c4-25334e07ce1c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f2d7a0-07e2-4575-b780-8c88656ffd09]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:27:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:27:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf2afb0-5fd3-48be-8388-852440a82c54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9, portal: 172.16.0.220,3260]
Nov 28 23:27:19 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9, portal: 172.16.0.220,3260] successful.
Nov 28 23:27:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd464ed-598a-42d7-8e31-d25615d8c269]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f2e78-5eb5-4747-8680-b9c4524fbee7]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:27:19 user nova-compute[74959]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 (non-flash)
Nov 28 23:27:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:27:19 user nova-compute[74959]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 (non-flash)
Nov 28 23:27:19 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d585e1-b2a8-4a8c-b58f-be630d181f8b]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:27:19 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOpSjZAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:27:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:27:20 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23134663731313761', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:27:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134663731313761', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:27:20 user nova-compute[74959]: DEBUG nova.objects.instance [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'flavor' on Instance uuid 72955328-2f30-44a5-abe3-1d3014be72d6 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:27:20 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:27:20 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:27:20 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:27:20 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:27:20 user nova-compute[74959]:   <serial>63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9</serial>
Nov 28 23:27:20 user nova-compute[74959]: </disk>
Nov 28 23:27:20 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:27:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:27:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:27:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] No VIF found with MAC fa:16:3e:e6:7a:91, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:27:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-528f1b9c-bffa-414d-b2aa-43f8e5a33e38 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.011s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:23 user nova-compute[74959]: INFO nova.compute.manager [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Detaching volume 63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9
Nov 28 23:27:23 user nova-compute[74959]: INFO nova.virt.block_device [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Attempting to driver detach volume 63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 from mountpoint /dev/vdb
Nov 28 23:27:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Attempting to detach device vdb from instance 72955328-2f30-44a5-abe3-1d3014be72d6 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:27:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:27:23 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:27:23 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:27:23 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:27:23 user nova-compute[74959]:   <serial>63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9</serial>
Nov 28 23:27:23 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:27:23 user nova-compute[74959]: </disk>
Nov 28 23:27:23 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:27:23 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Successfully detached device vdb from instance 72955328-2f30-44a5-abe3-1d3014be72d6 from the persistent domain config.
Nov 28 23:27:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72955328-2f30-44a5-abe3-1d3014be72d6 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:27:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:27:23 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:27:23 user nova-compute[74959]:   <source dev="/dev/sdc"/>
Nov 28 23:27:23 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:27:23 user nova-compute[74959]:   <serial>63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9</serial>
Nov 28 23:27:23 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:27:23 user nova-compute[74959]: </disk>
Nov 28 23:27:23 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:27:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72955328-2f30-44a5-abe3-1d3014be72d6 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:27:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:27:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:26 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:27:26 user nova-compute[74959]: INFO nova.compute.claims [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Claim successful on node user
Nov 28 23:27:26 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:27:26 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG nova.network.neutron [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:27:27 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:27:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG nova.policy [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd66a584198ab4b35bde53ddc47f412ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c298516145a14889933df60fb41a7dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:27:27 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Creating image(s)
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "/opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "/opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "/opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk 1073741824" returned: 0 in 0.096s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.network.neutron [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Successfully created port: e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Cannot resize image /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Ensure instance console log exists: /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.network.neutron [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Successfully updated port: e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquired lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.network.neutron [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-7702acd5-2a9e-4060-81ea-9512d06ef53e req-29d1954f-7324-43be-94c8-8d9dd1c84010 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received event network-changed-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.compute.manager [req-7702acd5-2a9e-4060-81ea-9512d06ef53e req-29d1954f-7324-43be-94c8-8d9dd1c84010 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Refreshing instance network info cache due to event network-changed-e2aa6b0e-ef11-4876-9c30-df553acda824. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7702acd5-2a9e-4060-81ea-9512d06ef53e req-29d1954f-7324-43be-94c8-8d9dd1c84010 service nova] Acquiring lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:27:28 user nova-compute[74959]: DEBUG nova.network.neutron [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.network.neutron [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updating instance_info_cache with network_info: [{"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Releasing lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Instance network_info: |[{"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7702acd5-2a9e-4060-81ea-9512d06ef53e req-29d1954f-7324-43be-94c8-8d9dd1c84010 service nova] Acquired lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.network.neutron [req-7702acd5-2a9e-4060-81ea-9512d06ef53e req-29d1954f-7324-43be-94c8-8d9dd1c84010 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Refreshing network info cache for port e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Start _get_guest_xml network_info=[{"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:27:29 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:27:29 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1401087175',display_name='tempest-ServersNegativeTestJSON-server-1401087175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1401087175',id=47,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c298516145a14889933df60fb41a7dfb',ramdisk_id='',reservation_id='r-3d0u6jjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1823254971',owner_user_name='tempest-ServersNegativeTestJSON-1823254971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:27:27Z,user_data=None,user_id='d66a584198ab4b35bde53ddc47f412ba',uuid=b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converting VIF {"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:8e:82,bridge_name='br-int',has_traffic_filtering=True,id=e2aa6b0e-ef11-4876-9c30-df553acda824,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aa6b0e-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.objects.instance [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lazy-loading 'pci_devices' on Instance uuid b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:27:29 user nova-compute[74959]:   <uuid>b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7</uuid>
Nov 28 23:27:29 user nova-compute[74959]:   <name>instance-0000002f</name>
Nov 28 23:27:29 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:27:29 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:27:29 user nova-compute[74959]:   <metadata>
Nov 28 23:27:29 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:27:29 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:27:29 user nova-compute[74959]:       <nova:name>tempest-ServersNegativeTestJSON-server-1401087175</nova:name>
Nov 28 23:27:29 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:27:29</nova:creationTime>
Nov 28 23:27:29 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:27:29 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:27:29 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:27:29 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:27:29 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:27:29 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:27:29 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:27:29 user nova-compute[74959]:       <nova:owner>
Nov 28 23:27:29 user nova-compute[74959]:         <nova:user uuid="d66a584198ab4b35bde53ddc47f412ba">tempest-ServersNegativeTestJSON-1823254971-project-member</nova:user>
Nov 28 23:27:29 user nova-compute[74959]:         <nova:project uuid="c298516145a14889933df60fb41a7dfb">tempest-ServersNegativeTestJSON-1823254971</nova:project>
Nov 28 23:27:29 user nova-compute[74959]:       </nova:owner>
Nov 28 23:27:29 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:27:29 user nova-compute[74959]:       <nova:ports>
Nov 28 23:27:29 user nova-compute[74959]:         <nova:port uuid="e2aa6b0e-ef11-4876-9c30-df553acda824">
Nov 28 23:27:29 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 23:27:29 user nova-compute[74959]:         </nova:port>
Nov 28 23:27:29 user nova-compute[74959]:       </nova:ports>
Nov 28 23:27:29 user nova-compute[74959]:     </nova:instance>
Nov 28 23:27:29 user nova-compute[74959]:   </metadata>
Nov 28 23:27:29 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:27:29 user nova-compute[74959]:     <system>
Nov 28 23:27:29 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:27:29 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:27:29 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:27:29 user nova-compute[74959]:       <entry name="serial">b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7</entry>
Nov 28 23:27:29 user nova-compute[74959]:       <entry name="uuid">b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7</entry>
Nov 28 23:27:29 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:27:29 user nova-compute[74959]:     </system>
Nov 28 23:27:29 user nova-compute[74959]:   </sysinfo>
Nov 28 23:27:29 user nova-compute[74959]:   <os>
Nov 28 23:27:29 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:27:29 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:27:29 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:27:29 user nova-compute[74959]:   </os>
Nov 28 23:27:29 user nova-compute[74959]:   <features>
Nov 28 23:27:29 user nova-compute[74959]:     <acpi/>
Nov 28 23:27:29 user nova-compute[74959]:     <apic/>
Nov 28 23:27:29 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:27:29 user nova-compute[74959]:   </features>
Nov 28 23:27:29 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:27:29 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:27:29 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:27:29 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:27:29 user nova-compute[74959]:   </clock>
Nov 28 23:27:29 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:27:29 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:27:29 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:27:29 user nova-compute[74959]:   </cpu>
Nov 28 23:27:29 user nova-compute[74959]:   <devices>
Nov 28 23:27:29 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:27:29 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:27:29 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk"/>
Nov 28 23:27:29 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:27:29 user nova-compute[74959]:     </disk>
Nov 28 23:27:29 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:27:29 user nova-compute[74959]:       <mac address="fa:16:3e:21:8e:82"/>
Nov 28 23:27:29 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:27:29 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:27:29 user nova-compute[74959]:       <target dev="tape2aa6b0e-ef"/>
Nov 28 23:27:29 user nova-compute[74959]:     </interface>
Nov 28 23:27:29 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:27:29 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/console.log" append="off"/>
Nov 28 23:27:29 user nova-compute[74959]:     </serial>
Nov 28 23:27:29 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:27:29 user nova-compute[74959]:     <video>
Nov 28 23:27:29 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:27:29 user nova-compute[74959]:     </video>
Nov 28 23:27:29 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:27:29 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:27:29 user nova-compute[74959]:     </rng>
Nov 28 23:27:29 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:27:29 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:27:29 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:27:29 user nova-compute[74959]:     </memballoon>
Nov 28 23:27:29 user nova-compute[74959]:   </devices>
Nov 28 23:27:29 user nova-compute[74959]: </domain>
Nov 28 23:27:29 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1401087175',display_name='tempest-ServersNegativeTestJSON-server-1401087175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1401087175',id=47,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c298516145a14889933df60fb41a7dfb',ramdisk_id='',reservation_id='r-3d0u6jjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1823254971',owner_user_name='tempest-ServersNegativeTestJSON-1823254971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:27:27Z,user_data=None,user_id='d66a584198ab4b35bde53ddc47f412ba',uuid=b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converting VIF {"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:8e:82,bridge_name='br-int',has_traffic_filtering=True,id=e2aa6b0e-ef11-4876-9c30-df553acda824,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aa6b0e-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG os_vif [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:8e:82,bridge_name='br-int',has_traffic_filtering=True,id=e2aa6b0e-ef11-4876-9c30-df553acda824,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aa6b0e-ef') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23ba2e4b-5184-5f73-a651-1ca6a41a752f', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2aa6b0e-ef, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2aa6b0e-ef, col_values=(('qos', UUID('42581fa5-f008-4f0e-998e-143b61b62158')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2aa6b0e-ef, col_values=(('external_ids', {'iface-id': 'e2aa6b0e-ef11-4876-9c30-df553acda824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:8e:82', 'vm-uuid': 'b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:29 user nova-compute[74959]: INFO os_vif [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:8e:82,bridge_name='br-int',has_traffic_filtering=True,id=e2aa6b0e-ef11-4876-9c30-df553acda824,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aa6b0e-ef')
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] No VIF found with MAC fa:16:3e:21:8e:82, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.network.neutron [req-7702acd5-2a9e-4060-81ea-9512d06ef53e req-29d1954f-7324-43be-94c8-8d9dd1c84010 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updated VIF entry in instance network info cache for port e2aa6b0e-ef11-4876-9c30-df553acda824. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG nova.network.neutron [req-7702acd5-2a9e-4060-81ea-9512d06ef53e req-29d1954f-7324-43be-94c8-8d9dd1c84010 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updating instance_info_cache with network_info: [{"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:27:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7702acd5-2a9e-4060-81ea-9512d06ef53e req-29d1954f-7324-43be-94c8-8d9dd1c84010 service nova] Releasing lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-e08e6ca8-0543-496a-bfd9-7de20e786237 req-c3064b63-f9fe-44bb-9b19-11042b4fe803 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received event network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e08e6ca8-0543-496a-bfd9-7de20e786237 req-c3064b63-f9fe-44bb-9b19-11042b4fe803 service nova] Acquiring lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e08e6ca8-0543-496a-bfd9-7de20e786237 req-c3064b63-f9fe-44bb-9b19-11042b4fe803 service nova] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e08e6ca8-0543-496a-bfd9-7de20e786237 req-c3064b63-f9fe-44bb-9b19-11042b4fe803 service nova] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:30 user nova-compute[74959]: DEBUG nova.compute.manager [req-e08e6ca8-0543-496a-bfd9-7de20e786237 req-c3064b63-f9fe-44bb-9b19-11042b4fe803 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] No waiting events found dispatching network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:27:30 user nova-compute[74959]: WARNING nova.compute.manager [req-e08e6ca8-0543-496a-bfd9-7de20e786237 req-c3064b63-f9fe-44bb-9b19-11042b4fe803 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received unexpected event network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 for instance with vm_state building and task_state spawning.
Nov 28 23:27:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:27:32 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Instance spawned successfully.
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:27:32 user nova-compute[74959]: INFO nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-ced98173-01c9-4907-967f-3572d36ee70c req-aa0c9693-4862-4e37-9032-9c3bafe4a0af service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received event network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ced98173-01c9-4907-967f-3572d36ee70c req-aa0c9693-4862-4e37-9032-9c3bafe4a0af service nova] Acquiring lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ced98173-01c9-4907-967f-3572d36ee70c req-aa0c9693-4862-4e37-9032-9c3bafe4a0af service nova] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ced98173-01c9-4907-967f-3572d36ee70c req-aa0c9693-4862-4e37-9032-9c3bafe4a0af service nova] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:32 user nova-compute[74959]: DEBUG nova.compute.manager [req-ced98173-01c9-4907-967f-3572d36ee70c req-aa0c9693-4862-4e37-9032-9c3bafe4a0af service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] No waiting events found dispatching network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:27:32 user nova-compute[74959]: WARNING nova.compute.manager [req-ced98173-01c9-4907-967f-3572d36ee70c req-aa0c9693-4862-4e37-9032-9c3bafe4a0af service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received unexpected event network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 for instance with vm_state building and task_state spawning.
Nov 28 23:27:32 user nova-compute[74959]: INFO nova.compute.manager [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Took 6.29 seconds to build instance.
Nov 28 23:27:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-79f8b522-9e1b-4f25-9185-31b499288f62 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.389s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:43 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72955328-2f30-44a5-abe3-1d3014be72d6 is timed out.
Nov 28 23:27:43 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Successfully detached device vdb from instance 72955328-2f30-44a5-abe3-1d3014be72d6 from the live domain config.
Nov 28 23:27:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOpSjZAm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:27:43 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fb8813-3b0d-42b9-ade1-990be5d10bd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:27:43 user nova-compute[74959]: No targets found.
Nov 28 23:27:43 user nova-compute[74959]: iSNS:
Nov 28 23:27:43 user nova-compute[74959]: No targets found.
Nov 28 23:27:43 user nova-compute[74959]: STATIC:
Nov 28 23:27:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77
Nov 28 23:27:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:27:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:27:43 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9
Nov 28 23:27:43 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:27:43 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:27:43 user nova-compute[74959]: FIRMWARE:
Nov 28 23:27:43 user nova-compute[74959]: No targets found.
Nov 28 23:27:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:27:43 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:27:43 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[14436988-3ee2-47f2-98a7-9df27e26c4c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[647f2d36-7c84-43ff-a6d4-a3a0bf498b4f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:27:43 user nova-compute[74959]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 (non-flash)
Nov 28 23:27:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:27:43 user nova-compute[74959]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 (non-flash)
Nov 28 23:27:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc7c7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9'): ({'sdc'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Removing single pathed devices sdc {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c172d5a3-47ce-4e3e-9ed4-5d96f10aee03]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aed0dd-1ff3-4bfb-aaae-e7a263fc9043]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Flushing IO for device /dev/sdc {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2489c36c-09aa-4c74-912e-88c07fd9372d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:27:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[060417ab-da48-4be0-a27c-8237d4d29b81]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1567f57f-2d5c-4a9a-bce3-a85add9a9001]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2690bf45-13d6-4aaf-bfee-ba7ca504906f]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9, portal: 172.16.0.220,3260]
Nov 28 23:27:44 user nova-compute[74959]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9, portal: 172.16.0.220,3260] successful.
Nov 28 23:27:44 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d7dbad-8c8d-4ce8-8c29-4b56f61ddea9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a60f51-cfc3-464e-953e-c920a2121f36]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] <== disconnect_volume: return (280ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:27:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:46 user nova-compute[74959]: DEBUG nova.objects.instance [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'flavor' on Instance uuid 72955328-2f30-44a5-abe3-1d3014be72d6 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:27:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-1418ec47-23f9-44e1-b441-b9ea0ed7a874 tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.720s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:27:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:27:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:27:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:27:55 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:27:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updating instance_info_cache with network_info: [{"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:27:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:27:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:27:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:27:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:27:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:28:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:28:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:28:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:28:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:06 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-e6f3d356-85c1-42c3-b67d-d96a1d098537 req-36121410-ac8e-4dfd-a1bc-2cb8b44258fb service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received event network-changed-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-e6f3d356-85c1-42c3-b67d-d96a1d098537 req-36121410-ac8e-4dfd-a1bc-2cb8b44258fb service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Refreshing instance network info cache due to event network-changed-5ccc77c2-c3bc-42cf-9a43-facccffec089. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e6f3d356-85c1-42c3-b67d-d96a1d098537 req-36121410-ac8e-4dfd-a1bc-2cb8b44258fb service nova] Acquiring lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e6f3d356-85c1-42c3-b67d-d96a1d098537 req-36121410-ac8e-4dfd-a1bc-2cb8b44258fb service nova] Acquired lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG nova.network.neutron [req-e6f3d356-85c1-42c3-b67d-d96a1d098537 req-36121410-ac8e-4dfd-a1bc-2cb8b44258fb service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Refreshing network info cache for port 5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.network.neutron [req-e6f3d356-85c1-42c3-b67d-d96a1d098537 req-36121410-ac8e-4dfd-a1bc-2cb8b44258fb service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updated VIF entry in instance network info cache for port 5ccc77c2-c3bc-42cf-9a43-facccffec089. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.network.neutron [req-e6f3d356-85c1-42c3-b67d-d96a1d098537 req-36121410-ac8e-4dfd-a1bc-2cb8b44258fb service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updating instance_info_cache with network_info: [{"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e6f3d356-85c1-42c3-b67d-d96a1d098537 req-36121410-ac8e-4dfd-a1bc-2cb8b44258fb service nova] Releasing lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:28:08 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:28:08 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=24.99350357055664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 1effa435-b29a-424b-938a-2d5a2bb61853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 72955328-2f30-44a5-abe3-1d3014be72d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 37863cc3-07b2-4787-9b7b-ad122bac0f05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:28:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-30083121-86f2-405a-849c-ca2c3c18030d req-6b5ed327-ff49-406c-a67c-099db867125f service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-changed-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:28:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-30083121-86f2-405a-849c-ca2c3c18030d req-6b5ed327-ff49-406c-a67c-099db867125f service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Refreshing instance network info cache due to event network-changed-712cc154-754e-4a9e-b30f-eed422d7ece0. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:28:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-30083121-86f2-405a-849c-ca2c3c18030d req-6b5ed327-ff49-406c-a67c-099db867125f service nova] Acquiring lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:28:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-30083121-86f2-405a-849c-ca2c3c18030d req-6b5ed327-ff49-406c-a67c-099db867125f service nova] Acquired lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:28:13 user nova-compute[74959]: DEBUG nova.network.neutron [req-30083121-86f2-405a-849c-ca2c3c18030d req-6b5ed327-ff49-406c-a67c-099db867125f service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Refreshing network info cache for port 712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:14 user nova-compute[74959]: INFO nova.compute.manager [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Terminating instance
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-39935eb1-7535-4237-ba3e-f84881c11b82 req-943aac66-59c6-4c13-8314-433f6895c60d service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-vif-unplugged-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39935eb1-7535-4237-ba3e-f84881c11b82 req-943aac66-59c6-4c13-8314-433f6895c60d service nova] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39935eb1-7535-4237-ba3e-f84881c11b82 req-943aac66-59c6-4c13-8314-433f6895c60d service nova] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-39935eb1-7535-4237-ba3e-f84881c11b82 req-943aac66-59c6-4c13-8314-433f6895c60d service nova] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-39935eb1-7535-4237-ba3e-f84881c11b82 req-943aac66-59c6-4c13-8314-433f6895c60d service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] No waiting events found dispatching network-vif-unplugged-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-39935eb1-7535-4237-ba3e-f84881c11b82 req-943aac66-59c6-4c13-8314-433f6895c60d service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-vif-unplugged-712cc154-754e-4a9e-b30f-eed422d7ece0 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-30083121-86f2-405a-849c-ca2c3c18030d req-6b5ed327-ff49-406c-a67c-099db867125f service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updated VIF entry in instance network info cache for port 712cc154-754e-4a9e-b30f-eed422d7ece0. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-30083121-86f2-405a-849c-ca2c3c18030d req-6b5ed327-ff49-406c-a67c-099db867125f service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updating instance_info_cache with network_info: [{"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-30083121-86f2-405a-849c-ca2c3c18030d req-6b5ed327-ff49-406c-a67c-099db867125f service nova] Releasing lock "refresh_cache-72955328-2f30-44a5-abe3-1d3014be72d6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "15acc162-6664-49fb-9259-a16bb907ab72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "15acc162-6664-49fb-9259-a16bb907ab72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Instance destroyed successfully.
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'resources' on Instance uuid 72955328-2f30-44a5-abe3-1d3014be72d6 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1662876389',display_name='tempest-TestStampPattern-server-1662876389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1662876389',id=45,image_ref='e92c42bd-f27a-4dfe-b681-0096d7dc6eb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4cOJf3ly2NvcASqmkADfhxKCfflwBu5oBowaFWrr/ngo6IFGpG8y1JHOAFnUs10K+hlInoVkZOf7OKgfcb+GDy0CADTfxxg4vsu+43PCPS+aote/8Pp0lrXLBlefKGNA==',key_name='tempest-TestStampPattern-807671422',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcc33683ac964b16b2e8115112f7489b',ramdisk_id='',reservation_id='r-5qppcaxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1effa435-b29a-424b-938a-2d5a2bb61853',image_min_disk='1',image_min_ram='0',image_owner_id='fcc33683ac964b16b2e8115112f7489b',image_owner_project_name='tempest-TestStampPattern-1559655051',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1559655051-project-member',image_user_id='76f0678a37a54084a10ef59450bf48ae',owner_project_name='tempest-TestStampPattern-1559655051',owner_user_name='tempest-TestStampPattern-1559655051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:25:26Z,user_data=None,user_id='76f0678a37a54084a10ef59450bf48ae',uuid=72955328-2f30-44a5-abe3-1d3014be72d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converting VIF {"id": "712cc154-754e-4a9e-b30f-eed422d7ece0", "address": "fa:16:3e:e6:7a:91", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712cc154-75", "ovs_interfaceid": "712cc154-754e-4a9e-b30f-eed422d7ece0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:7a:91,bridge_name='br-int',has_traffic_filtering=True,id=712cc154-754e-4a9e-b30f-eed422d7ece0,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712cc154-75') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG os_vif [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:7a:91,bridge_name='br-int',has_traffic_filtering=True,id=712cc154-754e-4a9e-b30f-eed422d7ece0,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712cc154-75') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap712cc154-75, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c281845d-efdb-483f-91a8-9525f3454d8e) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:28:14 user nova-compute[74959]: INFO os_vif [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:7a:91,bridge_name='br-int',has_traffic_filtering=True,id=712cc154-754e-4a9e-b30f-eed422d7ece0,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712cc154-75')
Nov 28 23:28:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Deleting instance files /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6_del
Nov 28 23:28:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Deletion of /opt/stack/data/nova/instances/72955328-2f30-44a5-abe3-1d3014be72d6_del complete
Nov 28 23:28:15 user nova-compute[74959]: INFO nova.compute.manager [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 23:28:15 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:28:15 user nova-compute[74959]: INFO nova.compute.claims [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Claim successful on node user
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:28:15 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:28:15 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Took 0.39 seconds to deallocate network for instance.
Nov 28 23:28:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:15 user nova-compute[74959]: INFO nova.virt.block_device [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Booting with volume snapshot 62071c6a-a6bd-4b18-b48c-9fd2c95bd15e at /dev/vda
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.policy [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '762e77e638ee4789a04c58868648d0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b91fdb847ce9aefc26052b7e87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:28:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:15 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Deleted allocations for instance 72955328-2f30-44a5-abe3-1d3014be72d6
Nov 28 23:28:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c900fd5b-6d0b-4b93-bee3-2da432c0f65c tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "72955328-2f30-44a5-abe3-1d3014be72d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.742s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-62460d49-97e7-4580-be19-64ff16e50091 req-00ad7531-7c63-480f-89d4-8b55fa35a9aa service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-vif-deleted-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG nova.network.neutron [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Successfully created port: 4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-a08751a8-fa33-4181-bead-e5f2675765d9 req-e6e92066-f044-4146-97a4-7e4954d574b4 service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received event network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a08751a8-fa33-4181-bead-e5f2675765d9 req-e6e92066-f044-4146-97a4-7e4954d574b4 service nova] Acquiring lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a08751a8-fa33-4181-bead-e5f2675765d9 req-e6e92066-f044-4146-97a4-7e4954d574b4 service nova] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a08751a8-fa33-4181-bead-e5f2675765d9 req-e6e92066-f044-4146-97a4-7e4954d574b4 service nova] Lock "72955328-2f30-44a5-abe3-1d3014be72d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG nova.compute.manager [req-a08751a8-fa33-4181-bead-e5f2675765d9 req-e6e92066-f044-4146-97a4-7e4954d574b4 service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] No waiting events found dispatching network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:28:16 user nova-compute[74959]: WARNING nova.compute.manager [req-a08751a8-fa33-4181-bead-e5f2675765d9 req-e6e92066-f044-4146-97a4-7e4954d574b4 service nova] [instance: 72955328-2f30-44a5-abe3-1d3014be72d6] Received unexpected event network-vif-plugged-712cc154-754e-4a9e-b30f-eed422d7ece0 for instance with vm_state deleted and task_state None.
Nov 28 23:28:16 user nova-compute[74959]: DEBUG nova.network.neutron [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Successfully updated port: 4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquired lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG nova.network.neutron [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:28:16 user nova-compute[74959]: DEBUG nova.network.neutron [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:28:17 user nova-compute[74959]: DEBUG nova.network.neutron [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Updating instance_info_cache with network_info: [{"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:28:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Releasing lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:28:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Instance network_info: |[{"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:28:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-28451557-2ced-4662-95de-1ff594779eb2 req-13277b81-5df4-4323-bde5-15830d4082ad service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received event network-changed-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:28:18 user nova-compute[74959]: DEBUG nova.compute.manager [req-28451557-2ced-4662-95de-1ff594779eb2 req-13277b81-5df4-4323-bde5-15830d4082ad service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Refreshing instance network info cache due to event network-changed-4ce6c326-6fbd-495a-aa3c-667996c32f51. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:28:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28451557-2ced-4662-95de-1ff594779eb2 req-13277b81-5df4-4323-bde5-15830d4082ad service nova] Acquiring lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:28:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28451557-2ced-4662-95de-1ff594779eb2 req-13277b81-5df4-4323-bde5-15830d4082ad service nova] Acquired lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:28:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-28451557-2ced-4662-95de-1ff594779eb2 req-13277b81-5df4-4323-bde5-15830d4082ad service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Refreshing network info cache for port 4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:28:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-28451557-2ced-4662-95de-1ff594779eb2 req-13277b81-5df4-4323-bde5-15830d4082ad service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Updated VIF entry in instance network info cache for port 4ce6c326-6fbd-495a-aa3c-667996c32f51. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:28:18 user nova-compute[74959]: DEBUG nova.network.neutron [req-28451557-2ced-4662-95de-1ff594779eb2 req-13277b81-5df4-4323-bde5-15830d4082ad service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Updating instance_info_cache with network_info: [{"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:28:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-28451557-2ced-4662-95de-1ff594779eb2 req-13277b81-5df4-4323-bde5-15830d4082ad service nova] Releasing lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:28:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG os_brick.utils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcb7390-6ecd-447d-9464-ded8e4bae9bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0ff047-6095-4350-86b0-6c491c7b80a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f9dece-0bff-400a-b774-b3fda13c9e7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeee523-2396-4e8f-a1e3-ec1f41189872]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:28:21 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:28:21 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a7711-0ac5-49ba-8cb6-e550e4f3f3ac]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG os_brick.utils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:28:21 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Updating existing volume attachment record: 0ef514eb-0f9f-4302-901a-788285370a6f {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:28:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:28:28 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Creating image(s)
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Ensure instance console log exists: /opt/stack/data/nova/instances/15acc162-6664-49fb-9259-a16bb907ab72/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Start _get_guest_xml network_info=[{"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T23:28:09Z,direct_url=<?>,disk_format='qcow2',id=7f23153e-bc40-4528-a7cc-71e274e8752b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-372977561',owner='1e1c6b91fdb847ce9aefc26052b7e87c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T23:28:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIKTfzDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15acc162-6664-49fb-9259-a16bb907ab72', 'attached_at': '', 'detached_at': '', 'volume_id': 'e401eeba-2868-4f17-a478-c0f581b31b43', 'serial': 'e401eeba-2868-4f17-a478-c0f581b31b43'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '0ef514eb-0f9f-4302-901a-788285370a6f', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:28:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:28:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T23:28:09Z,direct_url=<?>,disk_format='qcow2',id=7f23153e-bc40-4528-a7cc-71e274e8752b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-372977561',owner='1e1c6b91fdb847ce9aefc26052b7e87c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T23:28:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIKTfzDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:28:28 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:28:28 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:28:28 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c04cfa-9759-4d71-ad9c-b79f793caba4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:28:28 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[145add12-4a46-41e9-a209-5edd21e37593]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43] added
Nov 28 23:28:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc676164-8197-40a0-8f3c-998304f62488]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[de75e8ff-a886-48e8-acc1-4256c579ac69]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIKTfzDb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIKTfzDb" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef4f3d5-b292-4593-b4b3-e1b90c104a96]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIKTfzDb'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02386cb-546b-4b0c-b969-e7c2101d2152]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37fc356-1f6f-440c-97bc-8b50565d1baf]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:28:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:28:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff17553-8380-4280-9b2a-35888d0b8507]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43, portal: 172.16.0.220,3260]
Nov 28 23:28:28 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43, portal: 172.16.0.220,3260] successful.
Nov 28 23:28:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d5f498-fbe8-43bc-aae8-d59185c0beed]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cabf6ca-6e80-486e-a829-e0eac6e84892]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:28:28 user nova-compute[74959]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 (non-flash)
Nov 28 23:28:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:28:28 user nova-compute[74959]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 (non-flash)
Nov 28 23:28:28 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e0785a-89ca-4bec-9d1c-1d8476c612b5]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:28:28 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIKTfzDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26265616461326137', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265616461326137', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1909257342',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1909257342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1909257342',id=48,image_ref='7f23153e-bc40-4528-a7cc-71e274e8752b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/QzHOFVctIlwUYUAc2SmmrAu48p5WQZLT3gaZsBnOkVwitvGPS/jtFsHPQFaaJi/q/hsmyUCF7sk40YpZB1x4nXxysb/Ts/IE/pWN2WmvZ0gEiRpz9T53v36QvJK/bDw==',key_name='tempest-keypair-109848965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-dvbcg293',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1296185511',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='762e77e638ee4789a04c58868648d0a0',uuid=15acc162-6664-49fb-9259-a16bb907ab72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f3:6f,bridge_name='br-int',has_traffic_filtering=True,id=4ce6c326-6fbd-495a-aa3c-667996c32f51,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce6c326-6f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.objects.instance [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'pci_devices' on Instance uuid 15acc162-6664-49fb-9259-a16bb907ab72 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:28:29 user nova-compute[74959]:   <uuid>15acc162-6664-49fb-9259-a16bb907ab72</uuid>
Nov 28 23:28:29 user nova-compute[74959]:   <name>instance-00000030</name>
Nov 28 23:28:29 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:28:29 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:28:29 user nova-compute[74959]:   <metadata>
Nov 28 23:28:29 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:28:29 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:28:29 user nova-compute[74959]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1909257342</nova:name>
Nov 28 23:28:29 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:28:28</nova:creationTime>
Nov 28 23:28:29 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:28:29 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:28:29 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:28:29 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:28:29 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:28:29 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:28:29 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:28:29 user nova-compute[74959]:       <nova:owner>
Nov 28 23:28:29 user nova-compute[74959]:         <nova:user uuid="762e77e638ee4789a04c58868648d0a0">tempest-TestVolumeBootPattern-1296185511-project-member</nova:user>
Nov 28 23:28:29 user nova-compute[74959]:         <nova:project uuid="1e1c6b91fdb847ce9aefc26052b7e87c">tempest-TestVolumeBootPattern-1296185511</nova:project>
Nov 28 23:28:29 user nova-compute[74959]:       </nova:owner>
Nov 28 23:28:29 user nova-compute[74959]:       <nova:root type="image" uuid="7f23153e-bc40-4528-a7cc-71e274e8752b"/>
Nov 28 23:28:29 user nova-compute[74959]:       <nova:ports>
Nov 28 23:28:29 user nova-compute[74959]:         <nova:port uuid="4ce6c326-6fbd-495a-aa3c-667996c32f51">
Nov 28 23:28:29 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 23:28:29 user nova-compute[74959]:         </nova:port>
Nov 28 23:28:29 user nova-compute[74959]:       </nova:ports>
Nov 28 23:28:29 user nova-compute[74959]:     </nova:instance>
Nov 28 23:28:29 user nova-compute[74959]:   </metadata>
Nov 28 23:28:29 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:28:29 user nova-compute[74959]:     <system>
Nov 28 23:28:29 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:28:29 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:28:29 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:28:29 user nova-compute[74959]:       <entry name="serial">15acc162-6664-49fb-9259-a16bb907ab72</entry>
Nov 28 23:28:29 user nova-compute[74959]:       <entry name="uuid">15acc162-6664-49fb-9259-a16bb907ab72</entry>
Nov 28 23:28:29 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:28:29 user nova-compute[74959]:     </system>
Nov 28 23:28:29 user nova-compute[74959]:   </sysinfo>
Nov 28 23:28:29 user nova-compute[74959]:   <os>
Nov 28 23:28:29 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:28:29 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:28:29 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:28:29 user nova-compute[74959]:   </os>
Nov 28 23:28:29 user nova-compute[74959]:   <features>
Nov 28 23:28:29 user nova-compute[74959]:     <acpi/>
Nov 28 23:28:29 user nova-compute[74959]:     <apic/>
Nov 28 23:28:29 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:28:29 user nova-compute[74959]:   </features>
Nov 28 23:28:29 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:28:29 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:28:29 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:28:29 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:28:29 user nova-compute[74959]:   </clock>
Nov 28 23:28:29 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:28:29 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:28:29 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:28:29 user nova-compute[74959]:   </cpu>
Nov 28 23:28:29 user nova-compute[74959]:   <devices>
Nov 28 23:28:29 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:28:29 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:28:29 user nova-compute[74959]:       <source dev="/dev/sdc"/>
Nov 28 23:28:29 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:28:29 user nova-compute[74959]:       <serial>e401eeba-2868-4f17-a478-c0f581b31b43</serial>
Nov 28 23:28:29 user nova-compute[74959]:     </disk>
Nov 28 23:28:29 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:28:29 user nova-compute[74959]:       <mac address="fa:16:3e:67:f3:6f"/>
Nov 28 23:28:29 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:28:29 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:28:29 user nova-compute[74959]:       <target dev="tap4ce6c326-6f"/>
Nov 28 23:28:29 user nova-compute[74959]:     </interface>
Nov 28 23:28:29 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:28:29 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/15acc162-6664-49fb-9259-a16bb907ab72/console.log" append="off"/>
Nov 28 23:28:29 user nova-compute[74959]:     </serial>
Nov 28 23:28:29 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:28:29 user nova-compute[74959]:     <video>
Nov 28 23:28:29 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:28:29 user nova-compute[74959]:     </video>
Nov 28 23:28:29 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:28:29 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:28:29 user nova-compute[74959]:     </rng>
Nov 28 23:28:29 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:28:29 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:28:29 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:28:29 user nova-compute[74959]:     </memballoon>
Nov 28 23:28:29 user nova-compute[74959]:   </devices>
Nov 28 23:28:29 user nova-compute[74959]: </domain>
Nov 28 23:28:29 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1909257342',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1909257342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1909257342',id=48,image_ref='7f23153e-bc40-4528-a7cc-71e274e8752b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/QzHOFVctIlwUYUAc2SmmrAu48p5WQZLT3gaZsBnOkVwitvGPS/jtFsHPQFaaJi/q/hsmyUCF7sk40YpZB1x4nXxysb/Ts/IE/pWN2WmvZ0gEiRpz9T53v36QvJK/bDw==',key_name='tempest-keypair-109848965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-dvbcg293',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1296185511',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='762e77e638ee4789a04c58868648d0a0',uuid=15acc162-6664-49fb-9259-a16bb907ab72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f3:6f,bridge_name='br-int',has_traffic_filtering=True,id=4ce6c326-6fbd-495a-aa3c-667996c32f51,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce6c326-6f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG os_vif [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f3:6f,bridge_name='br-int',has_traffic_filtering=True,id=4ce6c326-6fbd-495a-aa3c-667996c32f51,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce6c326-6f') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6779d86-f708-5aa3-83d5-009773b71c49', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ce6c326-6f, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ce6c326-6f, col_values=(('qos', UUID('49bcc787-871b-4e32-9747-e81541cfb150')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ce6c326-6f, col_values=(('external_ids', {'iface-id': '4ce6c326-6fbd-495a-aa3c-667996c32f51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:f3:6f', 'vm-uuid': '15acc162-6664-49fb-9259-a16bb907ab72'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:29 user nova-compute[74959]: INFO os_vif [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f3:6f,bridge_name='br-int',has_traffic_filtering=True,id=4ce6c326-6fbd-495a-aa3c-667996c32f51,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce6c326-6f')
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:28:29 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No VIF found with MAC fa:16:3e:67:f3:6f, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-c13156b0-f976-476b-9fbe-d54dfd8dd2b3 req-2d7ac13a-6501-4e74-9161-d13df7062a84 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received event network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c13156b0-f976-476b-9fbe-d54dfd8dd2b3 req-2d7ac13a-6501-4e74-9161-d13df7062a84 service nova] Acquiring lock "15acc162-6664-49fb-9259-a16bb907ab72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c13156b0-f976-476b-9fbe-d54dfd8dd2b3 req-2d7ac13a-6501-4e74-9161-d13df7062a84 service nova] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c13156b0-f976-476b-9fbe-d54dfd8dd2b3 req-2d7ac13a-6501-4e74-9161-d13df7062a84 service nova] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG nova.compute.manager [req-c13156b0-f976-476b-9fbe-d54dfd8dd2b3 req-2d7ac13a-6501-4e74-9161-d13df7062a84 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] No waiting events found dispatching network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:28:31 user nova-compute[74959]: WARNING nova.compute.manager [req-c13156b0-f976-476b-9fbe-d54dfd8dd2b3 req-2d7ac13a-6501-4e74-9161-d13df7062a84 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received unexpected event network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 for instance with vm_state building and task_state spawning.
Nov 28 23:28:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:28:33 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Instance spawned successfully.
Nov 28 23:28:33 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-612aff86-85ff-4f3b-8c84-f17f3b1dd91a req-0d7cb8aa-f4d2-4084-81b8-fa4e2e18a3cd service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received event network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-612aff86-85ff-4f3b-8c84-f17f3b1dd91a req-0d7cb8aa-f4d2-4084-81b8-fa4e2e18a3cd service nova] Acquiring lock "15acc162-6664-49fb-9259-a16bb907ab72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-612aff86-85ff-4f3b-8c84-f17f3b1dd91a req-0d7cb8aa-f4d2-4084-81b8-fa4e2e18a3cd service nova] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-612aff86-85ff-4f3b-8c84-f17f3b1dd91a req-0d7cb8aa-f4d2-4084-81b8-fa4e2e18a3cd service nova] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:33 user nova-compute[74959]: DEBUG nova.compute.manager [req-612aff86-85ff-4f3b-8c84-f17f3b1dd91a req-0d7cb8aa-f4d2-4084-81b8-fa4e2e18a3cd service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] No waiting events found dispatching network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:28:33 user nova-compute[74959]: WARNING nova.compute.manager [req-612aff86-85ff-4f3b-8c84-f17f3b1dd91a req-0d7cb8aa-f4d2-4084-81b8-fa4e2e18a3cd service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received unexpected event network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 for instance with vm_state building and task_state spawning.
Nov 28 23:28:33 user nova-compute[74959]: INFO nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 28 23:28:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:28:33 user nova-compute[74959]: INFO nova.compute.manager [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Took 18.42 seconds to build instance.
Nov 28 23:28:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-693b195a-163a-4d3f-8075-97543bfd537c tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "15acc162-6664-49fb-9259-a16bb907ab72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.562s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:28:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:28:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:28:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:28:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:28:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:28:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:28:56 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:28:56 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 1effa435-b29a-424b-938a-2d5a2bb61853 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:28:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating instance_info_cache with network_info: [{"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:28:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:28:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:28:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:28:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:29:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:29:08 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:29:08 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:29:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=24.984615325927734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 1effa435-b29a-424b-938a-2d5a2bb61853 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 37863cc3-07b2-4787-9b7b-ad122bac0f05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 15acc162-6664-49fb-9259-a16bb907ab72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:29:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:29:09 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:29:09 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:29:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:29:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-3f7adf54-30ff-4b26-a8d2-6d3a4c42473c req-c0e83e98-c190-43c0-994b-56bfa41f3951 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-changed-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-3f7adf54-30ff-4b26-a8d2-6d3a4c42473c req-c0e83e98-c190-43c0-994b-56bfa41f3951 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Refreshing instance network info cache due to event network-changed-2c30f0a4-c515-41ca-8221-127697ead54c. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3f7adf54-30ff-4b26-a8d2-6d3a4c42473c req-c0e83e98-c190-43c0-994b-56bfa41f3951 service nova] Acquiring lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3f7adf54-30ff-4b26-a8d2-6d3a4c42473c req-c0e83e98-c190-43c0-994b-56bfa41f3951 service nova] Acquired lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-3f7adf54-30ff-4b26-a8d2-6d3a4c42473c req-c0e83e98-c190-43c0-994b-56bfa41f3951 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Refreshing network info cache for port 2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:12 user nova-compute[74959]: INFO nova.compute.manager [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Terminating instance
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-3f7adf54-30ff-4b26-a8d2-6d3a4c42473c req-c0e83e98-c190-43c0-994b-56bfa41f3951 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updated VIF entry in instance network info cache for port 2c30f0a4-c515-41ca-8221-127697ead54c. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-3f7adf54-30ff-4b26-a8d2-6d3a4c42473c req-c0e83e98-c190-43c0-994b-56bfa41f3951 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating instance_info_cache with network_info: [{"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3f7adf54-30ff-4b26-a8d2-6d3a4c42473c req-c0e83e98-c190-43c0-994b-56bfa41f3951 service nova] Releasing lock "refresh_cache-1effa435-b29a-424b-938a-2d5a2bb61853" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Instance destroyed successfully.
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.objects.instance [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lazy-loading 'resources' on Instance uuid 1effa435-b29a-424b-938a-2d5a2bb61853 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-261642393',display_name='tempest-TestStampPattern-server-261642393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-261642393',id=42,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4cOJf3ly2NvcASqmkADfhxKCfflwBu5oBowaFWrr/ngo6IFGpG8y1JHOAFnUs10K+hlInoVkZOf7OKgfcb+GDy0CADTfxxg4vsu+43PCPS+aote/8Pp0lrXLBlefKGNA==',key_name='tempest-TestStampPattern-807671422',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcc33683ac964b16b2e8115112f7489b',ramdisk_id='',reservation_id='r-onkicu8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1559655051',owner_user_name='tempest-TestStampPattern-1559655051-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:25:17Z,user_data=None,user_id='76f0678a37a54084a10ef59450bf48ae',uuid=1effa435-b29a-424b-938a-2d5a2bb61853,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converting VIF {"id": "2c30f0a4-c515-41ca-8221-127697ead54c", "address": "fa:16:3e:66:b2:b6", "network": {"id": "84adb108-964d-4f87-b6f8-42020712a383", "bridge": "br-int", "label": "tempest-TestStampPattern-78964631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc33683ac964b16b2e8115112f7489b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c30f0a4-c5", "ovs_interfaceid": "2c30f0a4-c515-41ca-8221-127697ead54c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:b2:b6,bridge_name='br-int',has_traffic_filtering=True,id=2c30f0a4-c515-41ca-8221-127697ead54c,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c30f0a4-c5') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG os_vif [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:b2:b6,bridge_name='br-int',has_traffic_filtering=True,id=2c30f0a4-c515-41ca-8221-127697ead54c,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c30f0a4-c5') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c30f0a4-c5, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfb41251-819c-4f78-831d-0c3b6d17cc82) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:12 user nova-compute[74959]: INFO os_vif [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:b2:b6,bridge_name='br-int',has_traffic_filtering=True,id=2c30f0a4-c515-41ca-8221-127697ead54c,network=Network(84adb108-964d-4f87-b6f8-42020712a383),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c30f0a4-c5')
Nov 28 23:29:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Deleting instance files /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853_del
Nov 28 23:29:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Deletion of /opt/stack/data/nova/instances/1effa435-b29a-424b-938a-2d5a2bb61853_del complete
Nov 28 23:29:13 user nova-compute[74959]: INFO nova.compute.manager [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 28 23:29:13 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:29:13 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:29:13 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:29:13 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:29:14 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Took 0.88 seconds to deallocate network for instance.
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-d7ce5fdf-5e48-4442-8606-124685533779 req-ba5521ef-043d-4082-a3c7-b7a140fa53eb service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-vif-deleted-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:29:14 user nova-compute[74959]: INFO nova.compute.manager [req-d7ce5fdf-5e48-4442-8606-124685533779 req-ba5521ef-043d-4082-a3c7-b7a140fa53eb service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Neutron deleted interface 2c30f0a4-c515-41ca-8221-127697ead54c; detaching it from the instance and deleting it from the info cache
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.network.neutron [req-d7ce5fdf-5e48-4442-8606-124685533779 req-ba5521ef-043d-4082-a3c7-b7a140fa53eb service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-vif-unplugged-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] No waiting events found dispatching network-vif-unplugged-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-vif-unplugged-2c30f0a4-c515-41ca-8221-127697ead54c for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received event network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] Acquiring lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] Lock "1effa435-b29a-424b-938a-2d5a2bb61853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] No waiting events found dispatching network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:29:14 user nova-compute[74959]: WARNING nova.compute.manager [req-9d25c6a8-b4ea-401d-aa63-44c126f5bfd2 req-084c8615-8d48-41d9-90fe-e9bac284cc71 service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Received unexpected event network-vif-plugged-2c30f0a4-c515-41ca-8221-127697ead54c for instance with vm_state active and task_state deleting.
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-d7ce5fdf-5e48-4442-8606-124685533779 req-ba5521ef-043d-4082-a3c7-b7a140fa53eb service nova] [instance: 1effa435-b29a-424b-938a-2d5a2bb61853] Detach interface failed, port_id=2c30f0a4-c515-41ca-8221-127697ead54c, reason: Instance 1effa435-b29a-424b-938a-2d5a2bb61853 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:14 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Deleted allocations for instance 1effa435-b29a-424b-938a-2d5a2bb61853
Nov 28 23:29:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-49fbeeea-4237-4893-8713-96ee2514cb8d tempest-TestStampPattern-1559655051 tempest-TestStampPattern-1559655051-project-member] Lock "1effa435-b29a-424b-938a-2d5a2bb61853" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.275s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "89e82a38-4031-405a-83e1-64608b868180" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:29:17 user nova-compute[74959]: INFO nova.compute.claims [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Claim successful on node user
Nov 28 23:29:17 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:29:17 user nova-compute[74959]: DEBUG nova.network.neutron [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:29:17 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.policy [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd66a584198ab4b35bde53ddc47f412ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c298516145a14889933df60fb41a7dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:29:18 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Creating image(s)
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "/opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "/opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "/opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk 1073741824" returned: 0 in 0.049s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.network.neutron [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Successfully created port: 2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Cannot resize image /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Ensure instance console log exists: /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.neutron [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Successfully updated port: 2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "refresh_cache-89e82a38-4031-405a-83e1-64608b868180" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquired lock "refresh_cache-89e82a38-4031-405a-83e1-64608b868180" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.neutron [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-12b5249b-22e1-4777-9a6b-d914e2b342ae req-8bdfd3cf-4456-4d4a-b916-f483b61e9fa2 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-changed-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.compute.manager [req-12b5249b-22e1-4777-9a6b-d914e2b342ae req-8bdfd3cf-4456-4d4a-b916-f483b61e9fa2 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Refreshing instance network info cache due to event network-changed-2528c2c9-99a2-4f2c-aec2-84551464e51c. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-12b5249b-22e1-4777-9a6b-d914e2b342ae req-8bdfd3cf-4456-4d4a-b916-f483b61e9fa2 service nova] Acquiring lock "refresh_cache-89e82a38-4031-405a-83e1-64608b868180" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.neutron [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.neutron [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Updating instance_info_cache with network_info: [{"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Releasing lock "refresh_cache-89e82a38-4031-405a-83e1-64608b868180" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Instance network_info: |[{"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-12b5249b-22e1-4777-9a6b-d914e2b342ae req-8bdfd3cf-4456-4d4a-b916-f483b61e9fa2 service nova] Acquired lock "refresh_cache-89e82a38-4031-405a-83e1-64608b868180" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.neutron [req-12b5249b-22e1-4777-9a6b-d914e2b342ae req-8bdfd3cf-4456-4d4a-b916-f483b61e9fa2 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Refreshing network info cache for port 2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Start _get_guest_xml network_info=[{"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:29:19 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:29:19 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-430668134',display_name='tempest-ServersNegativeTestJSON-server-430668134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-430668134',id=49,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c298516145a14889933df60fb41a7dfb',ramdisk_id='',reservation_id='r-jf7x4ccu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1823254971',owner_user_name='tempest-ServersNegativeTestJSON-1823254971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:29:18Z,user_data=None,user_id='d66a584198ab4b35bde53ddc47f412ba',uuid=89e82a38-4031-405a-83e1-64608b868180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converting VIF {"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=2528c2c9-99a2-4f2c-aec2-84551464e51c,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2528c2c9-99') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.objects.instance [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lazy-loading 'pci_devices' on Instance uuid 89e82a38-4031-405a-83e1-64608b868180 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:29:19 user nova-compute[74959]:   <uuid>89e82a38-4031-405a-83e1-64608b868180</uuid>
Nov 28 23:29:19 user nova-compute[74959]:   <name>instance-00000031</name>
Nov 28 23:29:19 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:29:19 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:29:19 user nova-compute[74959]:   <metadata>
Nov 28 23:29:19 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:29:19 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:29:19 user nova-compute[74959]:       <nova:name>tempest-ServersNegativeTestJSON-server-430668134</nova:name>
Nov 28 23:29:19 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:29:19</nova:creationTime>
Nov 28 23:29:19 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:29:19 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:29:19 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:29:19 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:29:19 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:29:19 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:29:19 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:29:19 user nova-compute[74959]:       <nova:owner>
Nov 28 23:29:19 user nova-compute[74959]:         <nova:user uuid="d66a584198ab4b35bde53ddc47f412ba">tempest-ServersNegativeTestJSON-1823254971-project-member</nova:user>
Nov 28 23:29:19 user nova-compute[74959]:         <nova:project uuid="c298516145a14889933df60fb41a7dfb">tempest-ServersNegativeTestJSON-1823254971</nova:project>
Nov 28 23:29:19 user nova-compute[74959]:       </nova:owner>
Nov 28 23:29:19 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:29:19 user nova-compute[74959]:       <nova:ports>
Nov 28 23:29:19 user nova-compute[74959]:         <nova:port uuid="2528c2c9-99a2-4f2c-aec2-84551464e51c">
Nov 28 23:29:19 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 23:29:19 user nova-compute[74959]:         </nova:port>
Nov 28 23:29:19 user nova-compute[74959]:       </nova:ports>
Nov 28 23:29:19 user nova-compute[74959]:     </nova:instance>
Nov 28 23:29:19 user nova-compute[74959]:   </metadata>
Nov 28 23:29:19 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:29:19 user nova-compute[74959]:     <system>
Nov 28 23:29:19 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:29:19 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:29:19 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:29:19 user nova-compute[74959]:       <entry name="serial">89e82a38-4031-405a-83e1-64608b868180</entry>
Nov 28 23:29:19 user nova-compute[74959]:       <entry name="uuid">89e82a38-4031-405a-83e1-64608b868180</entry>
Nov 28 23:29:19 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:29:19 user nova-compute[74959]:     </system>
Nov 28 23:29:19 user nova-compute[74959]:   </sysinfo>
Nov 28 23:29:19 user nova-compute[74959]:   <os>
Nov 28 23:29:19 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:29:19 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:29:19 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:29:19 user nova-compute[74959]:   </os>
Nov 28 23:29:19 user nova-compute[74959]:   <features>
Nov 28 23:29:19 user nova-compute[74959]:     <acpi/>
Nov 28 23:29:19 user nova-compute[74959]:     <apic/>
Nov 28 23:29:19 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:29:19 user nova-compute[74959]:   </features>
Nov 28 23:29:19 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:29:19 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:29:19 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:29:19 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:29:19 user nova-compute[74959]:   </clock>
Nov 28 23:29:19 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:29:19 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:29:19 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:29:19 user nova-compute[74959]:   </cpu>
Nov 28 23:29:19 user nova-compute[74959]:   <devices>
Nov 28 23:29:19 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:29:19 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:29:19 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk"/>
Nov 28 23:29:19 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:29:19 user nova-compute[74959]:     </disk>
Nov 28 23:29:19 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:29:19 user nova-compute[74959]:       <mac address="fa:16:3e:01:85:fa"/>
Nov 28 23:29:19 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:29:19 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:29:19 user nova-compute[74959]:       <target dev="tap2528c2c9-99"/>
Nov 28 23:29:19 user nova-compute[74959]:     </interface>
Nov 28 23:29:19 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:29:19 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/console.log" append="off"/>
Nov 28 23:29:19 user nova-compute[74959]:     </serial>
Nov 28 23:29:19 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:29:19 user nova-compute[74959]:     <video>
Nov 28 23:29:19 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:29:19 user nova-compute[74959]:     </video>
Nov 28 23:29:19 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:29:19 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:29:19 user nova-compute[74959]:     </rng>
Nov 28 23:29:19 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:29:19 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:29:19 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:29:19 user nova-compute[74959]:     </memballoon>
Nov 28 23:29:19 user nova-compute[74959]:   </devices>
Nov 28 23:29:19 user nova-compute[74959]: </domain>
Nov 28 23:29:19 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-430668134',display_name='tempest-ServersNegativeTestJSON-server-430668134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-430668134',id=49,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c298516145a14889933df60fb41a7dfb',ramdisk_id='',reservation_id='r-jf7x4ccu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1823254971',owner_user_name='tempest-ServersNegativeTestJSON-1823254971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:29:18Z,user_data=None,user_id='d66a584198ab4b35bde53ddc47f412ba',uuid=89e82a38-4031-405a-83e1-64608b868180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converting VIF {"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=2528c2c9-99a2-4f2c-aec2-84551464e51c,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2528c2c9-99') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG os_vif [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=2528c2c9-99a2-4f2c-aec2-84551464e51c,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2528c2c9-99') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c09ea2d9-97ba-50f9-8b51-46c5c93d5843', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2528c2c9-99, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2528c2c9-99, col_values=(('qos', UUID('7d136405-49a4-4a41-991e-407ba91ac899')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2528c2c9-99, col_values=(('external_ids', {'iface-id': '2528c2c9-99a2-4f2c-aec2-84551464e51c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:85:fa', 'vm-uuid': '89e82a38-4031-405a-83e1-64608b868180'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:19 user nova-compute[74959]: INFO os_vif [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=2528c2c9-99a2-4f2c-aec2-84551464e51c,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2528c2c9-99')
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:29:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] No VIF found with MAC fa:16:3e:01:85:fa, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:29:20 user nova-compute[74959]: DEBUG nova.network.neutron [req-12b5249b-22e1-4777-9a6b-d914e2b342ae req-8bdfd3cf-4456-4d4a-b916-f483b61e9fa2 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Updated VIF entry in instance network info cache for port 2528c2c9-99a2-4f2c-aec2-84551464e51c. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:29:20 user nova-compute[74959]: DEBUG nova.network.neutron [req-12b5249b-22e1-4777-9a6b-d914e2b342ae req-8bdfd3cf-4456-4d4a-b916-f483b61e9fa2 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Updating instance_info_cache with network_info: [{"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:29:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-12b5249b-22e1-4777-9a6b-d914e2b342ae req-8bdfd3cf-4456-4d4a-b916-f483b61e9fa2 service nova] Releasing lock "refresh_cache-89e82a38-4031-405a-83e1-64608b868180" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:29:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:21 user nova-compute[74959]: DEBUG nova.compute.manager [req-8edcb6ec-57a8-4d39-aa7a-137e70476999 req-db48a3de-5b40-43c5-9b0b-97b925de60a8 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:29:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8edcb6ec-57a8-4d39-aa7a-137e70476999 req-db48a3de-5b40-43c5-9b0b-97b925de60a8 service nova] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8edcb6ec-57a8-4d39-aa7a-137e70476999 req-db48a3de-5b40-43c5-9b0b-97b925de60a8 service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-8edcb6ec-57a8-4d39-aa7a-137e70476999 req-db48a3de-5b40-43c5-9b0b-97b925de60a8 service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:21 user nova-compute[74959]: DEBUG nova.compute.manager [req-8edcb6ec-57a8-4d39-aa7a-137e70476999 req-db48a3de-5b40-43c5-9b0b-97b925de60a8 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] No waiting events found dispatching network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:29:21 user nova-compute[74959]: WARNING nova.compute.manager [req-8edcb6ec-57a8-4d39-aa7a-137e70476999 req-db48a3de-5b40-43c5-9b0b-97b925de60a8 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received unexpected event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c for instance with vm_state building and task_state spawning.
Nov 28 23:29:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:29:23 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 89e82a38-4031-405a-83e1-64608b868180] Instance spawned successfully.
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:29:23 user nova-compute[74959]: INFO nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-3172c791-c018-466f-92ad-082683eeab72 req-ff12aeb5-a744-4168-9528-270600f61cd2 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3172c791-c018-466f-92ad-082683eeab72 req-ff12aeb5-a744-4168-9528-270600f61cd2 service nova] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3172c791-c018-466f-92ad-082683eeab72 req-ff12aeb5-a744-4168-9528-270600f61cd2 service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3172c791-c018-466f-92ad-082683eeab72 req-ff12aeb5-a744-4168-9528-270600f61cd2 service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:23 user nova-compute[74959]: DEBUG nova.compute.manager [req-3172c791-c018-466f-92ad-082683eeab72 req-ff12aeb5-a744-4168-9528-270600f61cd2 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] No waiting events found dispatching network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:29:23 user nova-compute[74959]: WARNING nova.compute.manager [req-3172c791-c018-466f-92ad-082683eeab72 req-ff12aeb5-a744-4168-9528-270600f61cd2 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received unexpected event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c for instance with vm_state building and task_state spawning.
Nov 28 23:29:23 user nova-compute[74959]: INFO nova.compute.manager [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Took 5.71 seconds to build instance.
Nov 28 23:29:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-72cccf37-d836-45ad-ac92-7ac6c1f538cc tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "89e82a38-4031-405a-83e1-64608b868180" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.817s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:29:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:29:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:29:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:29:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:29:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:29:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:29:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updating instance_info_cache with network_info: [{"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-37863cc3-07b2-4787-9b7b-ad122bac0f05" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:29:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:29:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:29:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:29:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:29:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:29:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:29:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:30:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:30:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-00daa5c3-107e-44d7-9481-0594a10f2724 req-72dcae08-84b8-4b69-b27b-3262e5ee4a89 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received event network-changed-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG nova.compute.manager [req-00daa5c3-107e-44d7-9481-0594a10f2724 req-72dcae08-84b8-4b69-b27b-3262e5ee4a89 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Refreshing instance network info cache due to event network-changed-4ce6c326-6fbd-495a-aa3c-667996c32f51. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-00daa5c3-107e-44d7-9481-0594a10f2724 req-72dcae08-84b8-4b69-b27b-3262e5ee4a89 service nova] Acquiring lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-00daa5c3-107e-44d7-9481-0594a10f2724 req-72dcae08-84b8-4b69-b27b-3262e5ee4a89 service nova] Acquired lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG nova.network.neutron [req-00daa5c3-107e-44d7-9481-0594a10f2724 req-72dcae08-84b8-4b69-b27b-3262e5ee4a89 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Refreshing network info cache for port 4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG nova.network.neutron [req-00daa5c3-107e-44d7-9481-0594a10f2724 req-72dcae08-84b8-4b69-b27b-3262e5ee4a89 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Updated VIF entry in instance network info cache for port 4ce6c326-6fbd-495a-aa3c-667996c32f51. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG nova.network.neutron [req-00daa5c3-107e-44d7-9481-0594a10f2724 req-72dcae08-84b8-4b69-b27b-3262e5ee4a89 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Updating instance_info_cache with network_info: [{"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:30:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-00daa5c3-107e-44d7-9481-0594a10f2724 req-72dcae08-84b8-4b69-b27b-3262e5ee4a89 service nova] Releasing lock "refresh_cache-15acc162-6664-49fb-9259-a16bb907ab72" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "15acc162-6664-49fb-9259-a16bb907ab72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "15acc162-6664-49fb-9259-a16bb907ab72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "15acc162-6664-49fb-9259-a16bb907ab72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:30:07 user nova-compute[74959]: INFO nova.compute.manager [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Terminating instance
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-94e4039b-895d-45e7-8c62-0fb521332eb6 req-9a41141b-7d14-4a37-8935-9a4a34fd6990 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received event network-vif-unplugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-94e4039b-895d-45e7-8c62-0fb521332eb6 req-9a41141b-7d14-4a37-8935-9a4a34fd6990 service nova] Acquiring lock "15acc162-6664-49fb-9259-a16bb907ab72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-94e4039b-895d-45e7-8c62-0fb521332eb6 req-9a41141b-7d14-4a37-8935-9a4a34fd6990 service nova] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-94e4039b-895d-45e7-8c62-0fb521332eb6 req-9a41141b-7d14-4a37-8935-9a4a34fd6990 service nova] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-94e4039b-895d-45e7-8c62-0fb521332eb6 req-9a41141b-7d14-4a37-8935-9a4a34fd6990 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] No waiting events found dispatching network-vif-unplugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.compute.manager [req-94e4039b-895d-45e7-8c62-0fb521332eb6 req-9a41141b-7d14-4a37-8935-9a4a34fd6990 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received event network-vif-unplugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:30:07 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Instance destroyed successfully.
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.objects.instance [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'resources' on Instance uuid 15acc162-6664-49fb-9259-a16bb907ab72 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1909257342',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1909257342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1909257342',id=48,image_ref='7f23153e-bc40-4528-a7cc-71e274e8752b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/QzHOFVctIlwUYUAc2SmmrAu48p5WQZLT3gaZsBnOkVwitvGPS/jtFsHPQFaaJi/q/hsmyUCF7sk40YpZB1x4nXxysb/Ts/IE/pWN2WmvZ0gEiRpz9T53v36QvJK/bDw==',key_name='tempest-keypair-109848965',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-dvbcg293',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1296185511',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='762e77e638ee4789a04c58868648d0a0',uuid=15acc162-6664-49fb-9259-a16bb907ab72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "address": "fa:16:3e:67:f3:6f", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ce6c326-6f", "ovs_interfaceid": "4ce6c326-6fbd-495a-aa3c-667996c32f51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:f3:6f,bridge_name='br-int',has_traffic_filtering=True,id=4ce6c326-6fbd-495a-aa3c-667996c32f51,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce6c326-6f') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_vif [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:f3:6f,bridge_name='br-int',has_traffic_filtering=True,id=4ce6c326-6fbd-495a-aa3c-667996c32f51,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce6c326-6f') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ce6c326-6f, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49bcc787-871b-4e32-9747-e81541cfb150) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:07 user nova-compute[74959]: INFO os_vif [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:f3:6f,bridge_name='br-int',has_traffic_filtering=True,id=4ce6c326-6fbd-495a-aa3c-667996c32f51,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ce6c326-6f')
Nov 28 23:30:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIKTfzDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:30:07 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d23e728-7837-4bba-81cd-9eb1552f56b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:30:07 user nova-compute[74959]: No targets found.
Nov 28 23:30:07 user nova-compute[74959]: iSNS:
Nov 28 23:30:07 user nova-compute[74959]: No targets found.
Nov 28 23:30:07 user nova-compute[74959]: STATIC:
Nov 28 23:30:07 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43
Nov 28 23:30:07 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:30:07 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:30:07 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77
Nov 28 23:30:07 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:30:07 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:30:07 user nova-compute[74959]: FIRMWARE:
Nov 28 23:30:07 user nova-compute[74959]: No targets found.
Nov 28 23:30:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:30:07 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:30:07 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee970437-2805-4216-bf2a-ed4c829cb82d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c230824-5472-431e-9f0a-721e3117815c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:30:07 user nova-compute[74959]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 (non-flash)
Nov 28 23:30:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:30:07 user nova-compute[74959]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 (non-flash)
Nov 28 23:30:07 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc79af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43'): ({'sdc'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Removing single pathed devices sdc {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8086498-35eb-4c92-9bd1-917e7d83807d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556dc6d-4bf9-461c-a514-fe8594b98b58]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flushing IO for device /dev/sdc {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de22b2-50d4-41de-8912-a7b4d72d8b25]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f452f705-1cd3-41ff-8282-6484615a009e]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e559f8-eff3-4726-bba3-60c90e89326e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c139f43-9a27-427a-a000-2d62989f70bc]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43, portal: 172.16.0.220,3260]
Nov 28 23:30:08 user nova-compute[74959]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43, portal: 172.16.0.220,3260] successful.
Nov 28 23:30:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e401eeba-2868-4f17-a478-c0f581b31b43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e247664f-b937-4da1-86a3-43e35db9f71a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== disconnect_volume: return (357ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:30:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Deleting instance files /opt/stack/data/nova/instances/15acc162-6664-49fb-9259-a16bb907ab72_del
Nov 28 23:30:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Deletion of /opt/stack/data/nova/instances/15acc162-6664-49fb-9259-a16bb907ab72_del complete
Nov 28 23:30:08 user nova-compute[74959]: INFO nova.compute.manager [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:08 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:30:08 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Took 0.76 seconds to deallocate network for instance.
Nov 28 23:30:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-138bf473-9271-4246-b0c8-2d2a453e4154 req-93c3bf3d-1ce8-4ce2-a2c9-406fbcfea653 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received event network-vif-deleted-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-364bec00-8fe0-4654-8d3b-45b7debeae1d req-799d31af-1c6c-484a-a81f-8ce748b3cfe1 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received event network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-364bec00-8fe0-4654-8d3b-45b7debeae1d req-799d31af-1c6c-484a-a81f-8ce748b3cfe1 service nova] Acquiring lock "15acc162-6664-49fb-9259-a16bb907ab72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-364bec00-8fe0-4654-8d3b-45b7debeae1d req-799d31af-1c6c-484a-a81f-8ce748b3cfe1 service nova] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-364bec00-8fe0-4654-8d3b-45b7debeae1d req-799d31af-1c6c-484a-a81f-8ce748b3cfe1 service nova] Lock "15acc162-6664-49fb-9259-a16bb907ab72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-364bec00-8fe0-4654-8d3b-45b7debeae1d req-799d31af-1c6c-484a-a81f-8ce748b3cfe1 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] No waiting events found dispatching network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:30:09 user nova-compute[74959]: WARNING nova.compute.manager [req-364bec00-8fe0-4654-8d3b-45b7debeae1d req-799d31af-1c6c-484a-a81f-8ce748b3cfe1 service nova] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Received unexpected event network-vif-plugged-4ce6c326-6fbd-495a-aa3c-667996c32f51 for instance with vm_state active and task_state deleting.
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:09 user nova-compute[74959]: INFO nova.compute.manager [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Took 0.93 seconds to detach 1 volumes for instance.
Nov 28 23:30:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 15acc162-6664-49fb-9259-a16bb907ab72] Deleting volume: e401eeba-2868-4f17-a478-c0f581b31b43 {{(pid=74959) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:30:10 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:30:10 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:30:10 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8645MB free_disk=25.079936981201172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.866s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:30:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.106s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:30:10 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Deleted allocations for instance 15acc162-6664-49fb-9259-a16bb907ab72
Nov 28 23:30:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-030dc3b5-4269-4ce3-9ca1-22c2d967c232 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "15acc162-6664-49fb-9259-a16bb907ab72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.061s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 37863cc3-07b2-4787-9b7b-ad122bac0f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 89e82a38-4031-405a-83e1-64608b868180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:30:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:30:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:30:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:30:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:30:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:30:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:30:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:30:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:30:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:30:57 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:30:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:30:58 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updating instance_info_cache with network_info: [{"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:30:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:30:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:30:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:00 user nova-compute[74959]: INFO nova.compute.manager [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Terminating instance
Nov 28 23:31:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-55dc53bb-0351-4fb8-860e-04985026b53b req-c8380703-a7b0-4095-a78e-dab4a8a69a48 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received event network-vif-unplugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-55dc53bb-0351-4fb8-860e-04985026b53b req-c8380703-a7b0-4095-a78e-dab4a8a69a48 service nova] Acquiring lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-55dc53bb-0351-4fb8-860e-04985026b53b req-c8380703-a7b0-4095-a78e-dab4a8a69a48 service nova] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-55dc53bb-0351-4fb8-860e-04985026b53b req-c8380703-a7b0-4095-a78e-dab4a8a69a48 service nova] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-55dc53bb-0351-4fb8-860e-04985026b53b req-c8380703-a7b0-4095-a78e-dab4a8a69a48 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] No waiting events found dispatching network-vif-unplugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:31:00 user nova-compute[74959]: DEBUG nova.compute.manager [req-55dc53bb-0351-4fb8-860e-04985026b53b req-c8380703-a7b0-4095-a78e-dab4a8a69a48 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received event network-vif-unplugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:31:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Instance destroyed successfully.
Nov 28 23:31:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'resources' on Instance uuid 37863cc3-07b2-4787-9b7b-ad122bac0f05 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1750471763',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1750471763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1750471763',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNsQtARnSmSUrFuP7QdzTSTW7m7bngXgZTqK2FiOWvnbeboE9gYPpp73ESDjmB3PviHLh58DGtFElaOLTgHcuwbyEl1/wBN1TUizqaWqcElhlRVsZA9EN30a3P8r61zSA==',key_name='tempest-keypair-163764882',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-j22hve09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='762e77e638ee4789a04c58868648d0a0',uuid=37863cc3-07b2-4787-9b7b-ad122bac0f05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "address": "fa:16:3e:c5:31:d7", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc77c2-c3", "ovs_interfaceid": "5ccc77c2-c3bc-42cf-9a43-facccffec089", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:31:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc77c2-c3bc-42cf-9a43-facccffec089,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc77c2-c3') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_vif [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:31:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc77c2-c3bc-42cf-9a43-facccffec089,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc77c2-c3') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccc77c2-c3, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90925e0e-f0a3-44f9-b2ff-1316770b499d) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:01 user nova-compute[74959]: INFO os_vif [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:31:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc77c2-c3bc-42cf-9a43-facccffec089,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc77c2-c3')
Nov 28 23:31:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVrHlSZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:31:01 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c545dd9f-2685-44e0-8a49-6f96f3c40a16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:31:01 user nova-compute[74959]: No targets found.
Nov 28 23:31:01 user nova-compute[74959]: iSNS:
Nov 28 23:31:01 user nova-compute[74959]: No targets found.
Nov 28 23:31:01 user nova-compute[74959]: STATIC:
Nov 28 23:31:01 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77
Nov 28 23:31:01 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:31:01 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:31:01 user nova-compute[74959]: FIRMWARE:
Nov 28 23:31:01 user nova-compute[74959]: No targets found.
Nov 28 23:31:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:31:01 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:31:01 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e608d556-6f6e-4d69-beea-aed889dffe89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa63f85f-37a5-4494-9293-3b424100d2bf]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:31:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 (non-flash)
Nov 28 23:31:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc51dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fcd734-2cd5-48b7-8243-e78bf7e51e88]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fc3043-616a-4c91-9c1b-63a70aa923f6]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[230840a4-6a95-43c8-b506-8b190dc68a75]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893487f-9ace-4a01-811b-15e5f30c0471]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe75e4b64-b55fa200cef4504a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e75e4b64', '/dev/disk/by-id/scsi-26235356661323030') {{(pid=86637) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b13596-a678-4e48-b62d-6492a6714953]: (4, None) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a71cbc9-4ee5-42e2-875b-c160d238e05b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[544a0ef1-0410-4375-a5ac-69321d6bccc4]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77, portal: 172.16.0.220,3260]
Nov 28 23:31:01 user nova-compute[74959]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77, portal: 172.16.0.220,3260] successful.
Nov 28 23:31:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cb5a36-04ed-449b-b8f0-aa2472160d77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[34026d11-460c-4899-97c3-234f113cf3fc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== disconnect_volume: return (287ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:31:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Deleting instance files /opt/stack/data/nova/instances/37863cc3-07b2-4787-9b7b-ad122bac0f05_del
Nov 28 23:31:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Deletion of /opt/stack/data/nova/instances/37863cc3-07b2-4787-9b7b-ad122bac0f05_del complete
Nov 28 23:31:01 user nova-compute[74959]: INFO nova.compute.manager [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 28 23:31:01 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:31:01 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:31:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:02 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:31:02 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Took 0.73 seconds to deallocate network for instance.
Nov 28 23:31:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-10f9f7b2-b172-4a6c-853f-5c0c632ae193 req-6857d3c4-9e0b-42df-9667-8b7fe4f62c2c service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received event network-vif-deleted-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-d589556a-7a00-4b7d-8077-46e7e72a5b66 req-274749cd-6784-46b1-acab-7d828d4903c5 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received event network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d589556a-7a00-4b7d-8077-46e7e72a5b66 req-274749cd-6784-46b1-acab-7d828d4903c5 service nova] Acquiring lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d589556a-7a00-4b7d-8077-46e7e72a5b66 req-274749cd-6784-46b1-acab-7d828d4903c5 service nova] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-d589556a-7a00-4b7d-8077-46e7e72a5b66 req-274749cd-6784-46b1-acab-7d828d4903c5 service nova] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:02 user nova-compute[74959]: DEBUG nova.compute.manager [req-d589556a-7a00-4b7d-8077-46e7e72a5b66 req-274749cd-6784-46b1-acab-7d828d4903c5 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] No waiting events found dispatching network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:31:02 user nova-compute[74959]: WARNING nova.compute.manager [req-d589556a-7a00-4b7d-8077-46e7e72a5b66 req-274749cd-6784-46b1-acab-7d828d4903c5 service nova] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Received unexpected event network-vif-plugged-5ccc77c2-c3bc-42cf-9a43-facccffec089 for instance with vm_state active and task_state deleting.
Nov 28 23:31:03 user nova-compute[74959]: INFO nova.compute.manager [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Took 0.82 seconds to detach 1 volumes for instance.
Nov 28 23:31:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 37863cc3-07b2-4787-9b7b-ad122bac0f05] Deleting volume: e0cb5a36-04ed-449b-b8f0-aa2472160d77 {{(pid=74959) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 23:31:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:03 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:31:03 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:31:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:03 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Deleted allocations for instance 37863cc3-07b2-4787-9b7b-ad122bac0f05
Nov 28 23:31:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f61d3611-82af-4ba7-b89b-ded946903530 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "37863cc3-07b2-4787-9b7b-ad122bac0f05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:31:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "89e82a38-4031-405a-83e1-64608b868180" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:07 user nova-compute[74959]: INFO nova.compute.manager [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Terminating instance
Nov 28 23:31:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:31:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-ece217ae-83b5-4413-ba65-28471a000fb5 req-71d1ce35-daa1-4826-8a32-a936b1e4e701 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-unplugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ece217ae-83b5-4413-ba65-28471a000fb5 req-71d1ce35-daa1-4826-8a32-a936b1e4e701 service nova] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ece217ae-83b5-4413-ba65-28471a000fb5 req-71d1ce35-daa1-4826-8a32-a936b1e4e701 service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ece217ae-83b5-4413-ba65-28471a000fb5 req-71d1ce35-daa1-4826-8a32-a936b1e4e701 service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-ece217ae-83b5-4413-ba65-28471a000fb5 req-71d1ce35-daa1-4826-8a32-a936b1e4e701 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] No waiting events found dispatching network-vif-unplugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.compute.manager [req-ece217ae-83b5-4413-ba65-28471a000fb5 req-71d1ce35-daa1-4826-8a32-a936b1e4e701 service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-unplugged-2528c2c9-99a2-4f2c-aec2-84551464e51c for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 89e82a38-4031-405a-83e1-64608b868180] Instance destroyed successfully.
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.objects.instance [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lazy-loading 'resources' on Instance uuid 89e82a38-4031-405a-83e1-64608b868180 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-430668134',display_name='tempest-ServersNegativeTestJSON-server-430668134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-430668134',id=49,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c298516145a14889933df60fb41a7dfb',ramdisk_id='',reservation_id='r-jf7x4ccu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1823254971',owner_user_name='tempest-ServersNegativeTestJSON-1823254971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:29:23Z,user_data=None,user_id='d66a584198ab4b35bde53ddc47f412ba',uuid=89e82a38-4031-405a-83e1-64608b868180,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converting VIF {"id": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "address": "fa:16:3e:01:85:fa", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2528c2c9-99", "ovs_interfaceid": "2528c2c9-99a2-4f2c-aec2-84551464e51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=2528c2c9-99a2-4f2c-aec2-84551464e51c,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2528c2c9-99') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG os_vif [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=2528c2c9-99a2-4f2c-aec2-84551464e51c,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2528c2c9-99') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2528c2c9-99, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d136405-49a4-4a41-991e-407ba91ac899) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: INFO os_vif [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=2528c2c9-99a2-4f2c-aec2-84551464e51c,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2528c2c9-99')
Nov 28 23:31:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Deleting instance files /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180_del
Nov 28 23:31:08 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Deletion of /opt/stack/data/nova/instances/89e82a38-4031-405a-83e1-64608b868180_del complete
Nov 28 23:31:08 user nova-compute[74959]: INFO nova.compute.manager [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: 89e82a38-4031-405a-83e1-64608b868180] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 28 23:31:08 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 89e82a38-4031-405a-83e1-64608b868180] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 89e82a38-4031-405a-83e1-64608b868180] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:08 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 89e82a38-4031-405a-83e1-64608b868180] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:31:08 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 89e82a38-4031-405a-83e1-64608b868180] Took 0.54 seconds to deallocate network for instance.
Nov 28 23:31:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-e25e4f76-c23a-4519-b5b8-edbe8d501b94 req-c17732e1-5c3e-456a-9b07-7c794595706b service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-deleted-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:09 user nova-compute[74959]: INFO nova.compute.manager [req-e25e4f76-c23a-4519-b5b8-edbe8d501b94 req-c17732e1-5c3e-456a-9b07-7c794595706b service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Neutron deleted interface 2528c2c9-99a2-4f2c-aec2-84551464e51c; detaching it from the instance and deleting it from the info cache
Nov 28 23:31:09 user nova-compute[74959]: DEBUG nova.network.neutron [req-e25e4f76-c23a-4519-b5b8-edbe8d501b94 req-c17732e1-5c3e-456a-9b07-7c794595706b service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG nova.compute.manager [req-e25e4f76-c23a-4519-b5b8-edbe8d501b94 req-c17732e1-5c3e-456a-9b07-7c794595706b service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Detach interface failed, port_id=2528c2c9-99a2-4f2c-aec2-84551464e51c, reason: Instance 89e82a38-4031-405a-83e1-64608b868180 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:09 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Deleted allocations for instance 89e82a38-4031-405a-83e1-64608b868180
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-40ffce03-1fb2-4671-8b56-c4952c284e49 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "89e82a38-4031-405a-83e1-64608b868180" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.546s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] No waiting events found dispatching network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:31:10 user nova-compute[74959]: WARNING nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received unexpected event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c for instance with vm_state deleted and task_state None.
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] No waiting events found dispatching network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:31:10 user nova-compute[74959]: WARNING nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received unexpected event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c for instance with vm_state deleted and task_state None.
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] No waiting events found dispatching network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:31:10 user nova-compute[74959]: WARNING nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received unexpected event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c for instance with vm_state deleted and task_state None.
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-unplugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] No waiting events found dispatching network-vif-unplugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:31:10 user nova-compute[74959]: WARNING nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received unexpected event network-vif-unplugged-2528c2c9-99a2-4f2c-aec2-84551464e51c for instance with vm_state deleted and task_state None.
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Acquiring lock "89e82a38-4031-405a-83e1-64608b868180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] Lock "89e82a38-4031-405a-83e1-64608b868180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] No waiting events found dispatching network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:31:10 user nova-compute[74959]: WARNING nova.compute.manager [req-a40ee8fa-d2ed-451a-9886-367b1780f822 req-929d4fa2-ea00-442e-b0bf-57cffa19ab3a service nova] [instance: 89e82a38-4031-405a-83e1-64608b868180] Received unexpected event network-vif-plugged-2528c2c9-99a2-4f2c-aec2-84551464e51c for instance with vm_state deleted and task_state None.
Nov 28 23:31:10 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:31:10 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.09848403930664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:31:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:31:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:31:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:31:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:31:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:31:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:31:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:31:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:31:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:31:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:31:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:31:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:31:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:31:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:31:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:31:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "99905904-3c0f-44ed-adb9-265776616ea4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "99905904-3c0f-44ed-adb9-265776616ea4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:32:01 user nova-compute[74959]: INFO nova.compute.claims [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Claim successful on node user
Nov 28 23:32:01 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:32:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:32:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:32:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:32:02 user nova-compute[74959]: INFO nova.virt.block_device [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Booting with volume 0a69edf1-b0fc-41b7-bc82-95c8df7fd564 at /dev/vda
Nov 28 23:32:02 user nova-compute[74959]: DEBUG nova.policy [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '762e77e638ee4789a04c58868648d0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b91fdb847ce9aefc26052b7e87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG os_brick.utils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9653b6b7-4767-4ea8-97d7-9fad46abf27f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd7e187-16a2-45f4-bf75-a5aa80013f5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca58c62-fdb3-4f86-be6c-53125b0cb4d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cdc3d0-5549-4194-abad-8ed33de64ac4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:32:02 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:32:02 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c4692-8664-4d4a-8027-cd4d16fbcefa]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG os_brick.utils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Updating existing volume attachment record: 7c716f66-ac99-40c7-a421-524d5097b1e4 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:32:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Successfully created port: 2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Successfully updated port: 2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquired lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-6bc61489-5e64-4b61-a559-a0f9448bffef req-6867a036-bdc3-4ee9-bd3b-48c96f4383f6 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received event network-changed-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG nova.compute.manager [req-6bc61489-5e64-4b61-a559-a0f9448bffef req-6867a036-bdc3-4ee9-bd3b-48c96f4383f6 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Refreshing instance network info cache due to event network-changed-2851e97c-3103-4434-b649-fac814336a3c. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6bc61489-5e64-4b61-a559-a0f9448bffef req-6867a036-bdc3-4ee9-bd3b-48c96f4383f6 service nova] Acquiring lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Updating instance_info_cache with network_info: [{"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Releasing lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Instance network_info: |[{"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6bc61489-5e64-4b61-a559-a0f9448bffef req-6867a036-bdc3-4ee9-bd3b-48c96f4383f6 service nova] Acquired lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:32:03 user nova-compute[74959]: DEBUG nova.network.neutron [req-6bc61489-5e64-4b61-a559-a0f9448bffef req-6867a036-bdc3-4ee9-bd3b-48c96f4383f6 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Refreshing network info cache for port 2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:32:04 user nova-compute[74959]: DEBUG nova.network.neutron [req-6bc61489-5e64-4b61-a559-a0f9448bffef req-6867a036-bdc3-4ee9-bd3b-48c96f4383f6 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Updated VIF entry in instance network info cache for port 2851e97c-3103-4434-b649-fac814336a3c. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:32:04 user nova-compute[74959]: DEBUG nova.network.neutron [req-6bc61489-5e64-4b61-a559-a0f9448bffef req-6867a036-bdc3-4ee9-bd3b-48c96f4383f6 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Updating instance_info_cache with network_info: [{"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:32:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-6bc61489-5e64-4b61-a559-a0f9448bffef req-6867a036-bdc3-4ee9-bd3b-48c96f4383f6 service nova] Releasing lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:32:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:32:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:32:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:32:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:32:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:32:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:32:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:32:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:32:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:32:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:32:09 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Creating image(s)
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Ensure instance console log exists: /opt/stack/data/nova/instances/99905904-3c0f-44ed-adb9-265776616ea4/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Start _get_guest_xml network_info=[{"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPEpvQzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '99905904-3c0f-44ed-adb9-265776616ea4', 'attached_at': '', 'detached_at': '', 'volume_id': '0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'serial': '0a69edf1-b0fc-41b7-bc82-95c8df7fd564'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '7c716f66-ac99-40c7-a421-524d5097b1e4', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:32:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:32:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPEpvQzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:32:09 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:32:09 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:32:09 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d96d94-4983-4d3d-91d4-88c1271109e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:32:09 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5228e0b-a448-4b6d-bb52-12fed876f750]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564] added
Nov 28 23:32:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a7ba04-9dfa-4961-9769-6284a2089f66]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[05860413-4f96-43e7-a062-8532ec316d49]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPEpvQzl {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPEpvQzl" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca333c15-4b85-47f9-95cc-8399079dfc0b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wPEpvQzl'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5add14dc-6c4c-4245-8d39-3d6c66738c83]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[db413e0f-f116-4107-a071-89c246e56258]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:32:09 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:32:09 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:32:09 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:32:09 user nova-compute[74959]: 
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a72c7-ce1d-4718-9661-e5041908c5a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260]
Nov 28 23:32:09 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260] successful.
Nov 28 23:32:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1da587-0383-43fb-9b2d-2b95e80463a1]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf678e20-3bde-4ac0-bc10-06ab3bb8940e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:32:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:32:09 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4799d1-2ea2-4057-8ae7-80c39b2b977f]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:32:09 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPEpvQzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23933313133376630', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933313133376630', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1535312198',display_name='tempest-TestVolumeBootPattern-server-1535312198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1535312198',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-6z3jyl61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:32:02Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=99905904-3c0f-44ed-adb9-265776616ea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0d:c6,bridge_name='br-int',has_traffic_filtering=True,id=2851e97c-3103-4434-b649-fac814336a3c,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2851e97c-31') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.objects.instance [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'pci_devices' on Instance uuid 99905904-3c0f-44ed-adb9-265776616ea4 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:32:10 user nova-compute[74959]:   <uuid>99905904-3c0f-44ed-adb9-265776616ea4</uuid>
Nov 28 23:32:10 user nova-compute[74959]:   <name>instance-00000032</name>
Nov 28 23:32:10 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:32:10 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:32:10 user nova-compute[74959]:   <metadata>
Nov 28 23:32:10 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:32:10 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:32:10 user nova-compute[74959]:       <nova:name>tempest-TestVolumeBootPattern-server-1535312198</nova:name>
Nov 28 23:32:10 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:32:09</nova:creationTime>
Nov 28 23:32:10 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:32:10 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:32:10 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:32:10 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:32:10 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:32:10 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:32:10 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:32:10 user nova-compute[74959]:       <nova:owner>
Nov 28 23:32:10 user nova-compute[74959]:         <nova:user uuid="762e77e638ee4789a04c58868648d0a0">tempest-TestVolumeBootPattern-1296185511-project-member</nova:user>
Nov 28 23:32:10 user nova-compute[74959]:         <nova:project uuid="1e1c6b91fdb847ce9aefc26052b7e87c">tempest-TestVolumeBootPattern-1296185511</nova:project>
Nov 28 23:32:10 user nova-compute[74959]:       </nova:owner>
Nov 28 23:32:10 user nova-compute[74959]:       <nova:ports>
Nov 28 23:32:10 user nova-compute[74959]:         <nova:port uuid="2851e97c-3103-4434-b649-fac814336a3c">
Nov 28 23:32:10 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 23:32:10 user nova-compute[74959]:         </nova:port>
Nov 28 23:32:10 user nova-compute[74959]:       </nova:ports>
Nov 28 23:32:10 user nova-compute[74959]:     </nova:instance>
Nov 28 23:32:10 user nova-compute[74959]:   </metadata>
Nov 28 23:32:10 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:32:10 user nova-compute[74959]:     <system>
Nov 28 23:32:10 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:32:10 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:32:10 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:32:10 user nova-compute[74959]:       <entry name="serial">99905904-3c0f-44ed-adb9-265776616ea4</entry>
Nov 28 23:32:10 user nova-compute[74959]:       <entry name="uuid">99905904-3c0f-44ed-adb9-265776616ea4</entry>
Nov 28 23:32:10 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:32:10 user nova-compute[74959]:     </system>
Nov 28 23:32:10 user nova-compute[74959]:   </sysinfo>
Nov 28 23:32:10 user nova-compute[74959]:   <os>
Nov 28 23:32:10 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:32:10 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:32:10 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:32:10 user nova-compute[74959]:   </os>
Nov 28 23:32:10 user nova-compute[74959]:   <features>
Nov 28 23:32:10 user nova-compute[74959]:     <acpi/>
Nov 28 23:32:10 user nova-compute[74959]:     <apic/>
Nov 28 23:32:10 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:32:10 user nova-compute[74959]:   </features>
Nov 28 23:32:10 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:32:10 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:32:10 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:32:10 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:32:10 user nova-compute[74959]:   </clock>
Nov 28 23:32:10 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:32:10 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:32:10 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:32:10 user nova-compute[74959]:   </cpu>
Nov 28 23:32:10 user nova-compute[74959]:   <devices>
Nov 28 23:32:10 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:32:10 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:32:10 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:32:10 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:32:10 user nova-compute[74959]:       <serial>0a69edf1-b0fc-41b7-bc82-95c8df7fd564</serial>
Nov 28 23:32:10 user nova-compute[74959]:     </disk>
Nov 28 23:32:10 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:32:10 user nova-compute[74959]:       <mac address="fa:16:3e:4c:0d:c6"/>
Nov 28 23:32:10 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:32:10 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:32:10 user nova-compute[74959]:       <target dev="tap2851e97c-31"/>
Nov 28 23:32:10 user nova-compute[74959]:     </interface>
Nov 28 23:32:10 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:32:10 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/99905904-3c0f-44ed-adb9-265776616ea4/console.log" append="off"/>
Nov 28 23:32:10 user nova-compute[74959]:     </serial>
Nov 28 23:32:10 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:32:10 user nova-compute[74959]:     <video>
Nov 28 23:32:10 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:32:10 user nova-compute[74959]:     </video>
Nov 28 23:32:10 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:32:10 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:32:10 user nova-compute[74959]:     </rng>
Nov 28 23:32:10 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:32:10 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:32:10 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:32:10 user nova-compute[74959]:     </memballoon>
Nov 28 23:32:10 user nova-compute[74959]:   </devices>
Nov 28 23:32:10 user nova-compute[74959]: </domain>
Nov 28 23:32:10 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1535312198',display_name='tempest-TestVolumeBootPattern-server-1535312198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1535312198',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-6z3jyl61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:32:02Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=99905904-3c0f-44ed-adb9-265776616ea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0d:c6,bridge_name='br-int',has_traffic_filtering=True,id=2851e97c-3103-4434-b649-fac814336a3c,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2851e97c-31') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG os_vif [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0d:c6,bridge_name='br-int',has_traffic_filtering=True,id=2851e97c-3103-4434-b649-fac814336a3c,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2851e97c-31') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5e4a170-5224-5886-bad6-d4b5eb54642b', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2851e97c-31, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2851e97c-31, col_values=(('qos', UUID('52267fd5-83ea-449d-a345-2162eaa37c0e')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2851e97c-31, col_values=(('external_ids', {'iface-id': '2851e97c-3103-4434-b649-fac814336a3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:0d:c6', 'vm-uuid': '99905904-3c0f-44ed-adb9-265776616ea4'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:10 user nova-compute[74959]: INFO os_vif [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0d:c6,bridge_name='br-int',has_traffic_filtering=True,id=2851e97c-3103-4434-b649-fac814336a3c,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2851e97c-31')
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:32:10 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No VIF found with MAC fa:16:3e:4c:0d:c6, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:32:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:32:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:32:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:32:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:32:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:32:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-c025f32f-02e5-45e2-8938-22848fd152e5 req-d80e5f70-58a8-4eab-8b7f-069fc53e53c1 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received event network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c025f32f-02e5-45e2-8938-22848fd152e5 req-d80e5f70-58a8-4eab-8b7f-069fc53e53c1 service nova] Acquiring lock "99905904-3c0f-44ed-adb9-265776616ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c025f32f-02e5-45e2-8938-22848fd152e5 req-d80e5f70-58a8-4eab-8b7f-069fc53e53c1 service nova] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-c025f32f-02e5-45e2-8938-22848fd152e5 req-d80e5f70-58a8-4eab-8b7f-069fc53e53c1 service nova] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG nova.compute.manager [req-c025f32f-02e5-45e2-8938-22848fd152e5 req-d80e5f70-58a8-4eab-8b7f-069fc53e53c1 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] No waiting events found dispatching network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:32:12 user nova-compute[74959]: WARNING nova.compute.manager [req-c025f32f-02e5-45e2-8938-22848fd152e5 req-d80e5f70-58a8-4eab-8b7f-069fc53e53c1 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received unexpected event network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c for instance with vm_state building and task_state spawning.
Nov 28 23:32:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:32:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-e3788f24-498a-4c86-9f85-7ff03e5b3565 req-949b175a-cd23-43fe-bb99-40903a0cd03e service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received event network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e3788f24-498a-4c86-9f85-7ff03e5b3565 req-949b175a-cd23-43fe-bb99-40903a0cd03e service nova] Acquiring lock "99905904-3c0f-44ed-adb9-265776616ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e3788f24-498a-4c86-9f85-7ff03e5b3565 req-949b175a-cd23-43fe-bb99-40903a0cd03e service nova] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e3788f24-498a-4c86-9f85-7ff03e5b3565 req-949b175a-cd23-43fe-bb99-40903a0cd03e service nova] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.manager [req-e3788f24-498a-4c86-9f85-7ff03e5b3565 req-949b175a-cd23-43fe-bb99-40903a0cd03e service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] No waiting events found dispatching network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:32:14 user nova-compute[74959]: WARNING nova.compute.manager [req-e3788f24-498a-4c86-9f85-7ff03e5b3565 req-949b175a-cd23-43fe-bb99-40903a0cd03e service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received unexpected event network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c for instance with vm_state building and task_state spawning.
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:32:14 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:32:14 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.096908569335938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:32:14 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Instance spawned successfully.
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 99905904-3c0f-44ed-adb9-265776616ea4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:32:14 user nova-compute[74959]: INFO nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:32:14 user nova-compute[74959]: INFO nova.compute.manager [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Took 12.87 seconds to build instance.
Nov 28 23:32:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-c5e27f39-c999-4530-ad21-e09a109adf19 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "99905904-3c0f-44ed-adb9-265776616ea4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.971s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:32:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:32:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:32:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:32:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:33:00 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:33:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updating instance_info_cache with network_info: [{"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:33:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:33:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:33:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:33:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:33:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:33:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:33:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8850MB free_disk=25.09555435180664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 99905904-3c0f-44ed-adb9-265776616ea4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:33:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:33:15 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:33:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:33:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:33:20 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:30 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:33:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:33:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:33:35 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:40 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:45 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:33:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:33:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:33:50 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-442f64a4-07ff-4178-95ea-51d728e79620 req-2820060c-ccde-47df-8daf-d7979506c56b service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received event network-changed-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG nova.compute.manager [req-442f64a4-07ff-4178-95ea-51d728e79620 req-2820060c-ccde-47df-8daf-d7979506c56b service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Refreshing instance network info cache due to event network-changed-2851e97c-3103-4434-b649-fac814336a3c. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-442f64a4-07ff-4178-95ea-51d728e79620 req-2820060c-ccde-47df-8daf-d7979506c56b service nova] Acquiring lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-442f64a4-07ff-4178-95ea-51d728e79620 req-2820060c-ccde-47df-8daf-d7979506c56b service nova] Acquired lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG nova.network.neutron [req-442f64a4-07ff-4178-95ea-51d728e79620 req-2820060c-ccde-47df-8daf-d7979506c56b service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Refreshing network info cache for port 2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "99905904-3c0f-44ed-adb9-265776616ea4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "99905904-3c0f-44ed-adb9-265776616ea4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "99905904-3c0f-44ed-adb9-265776616ea4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:33:53 user nova-compute[74959]: INFO nova.compute.manager [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Terminating instance
Nov 28 23:33:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG nova.network.neutron [req-442f64a4-07ff-4178-95ea-51d728e79620 req-2820060c-ccde-47df-8daf-d7979506c56b service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Updated VIF entry in instance network info cache for port 2851e97c-3103-4434-b649-fac814336a3c. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG nova.network.neutron [req-442f64a4-07ff-4178-95ea-51d728e79620 req-2820060c-ccde-47df-8daf-d7979506c56b service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Updating instance_info_cache with network_info: [{"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-442f64a4-07ff-4178-95ea-51d728e79620 req-2820060c-ccde-47df-8daf-d7979506c56b service nova] Releasing lock "refresh_cache-99905904-3c0f-44ed-adb9-265776616ea4" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:33:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-7e237bd1-e863-47a7-860f-484fe9bffae9 req-e592f948-ba81-4ae3-8998-1636a040286f service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received event network-vif-unplugged-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7e237bd1-e863-47a7-860f-484fe9bffae9 req-e592f948-ba81-4ae3-8998-1636a040286f service nova] Acquiring lock "99905904-3c0f-44ed-adb9-265776616ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7e237bd1-e863-47a7-860f-484fe9bffae9 req-e592f948-ba81-4ae3-8998-1636a040286f service nova] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7e237bd1-e863-47a7-860f-484fe9bffae9 req-e592f948-ba81-4ae3-8998-1636a040286f service nova] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-7e237bd1-e863-47a7-860f-484fe9bffae9 req-e592f948-ba81-4ae3-8998-1636a040286f service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] No waiting events found dispatching network-vif-unplugged-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.compute.manager [req-7e237bd1-e863-47a7-860f-484fe9bffae9 req-e592f948-ba81-4ae3-8998-1636a040286f service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received event network-vif-unplugged-2851e97c-3103-4434-b649-fac814336a3c for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:33:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Instance destroyed successfully.
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'resources' on Instance uuid 99905904-3c0f-44ed-adb9-265776616ea4 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1535312198',display_name='tempest-TestVolumeBootPattern-server-1535312198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1535312198',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-6z3jyl61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:32:14Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=99905904-3c0f-44ed-adb9-265776616ea4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "2851e97c-3103-4434-b649-fac814336a3c", "address": "fa:16:3e:4c:0d:c6", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2851e97c-31", "ovs_interfaceid": "2851e97c-3103-4434-b649-fac814336a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0d:c6,bridge_name='br-int',has_traffic_filtering=True,id=2851e97c-3103-4434-b649-fac814336a3c,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2851e97c-31') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_vif [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0d:c6,bridge_name='br-int',has_traffic_filtering=True,id=2851e97c-3103-4434-b649-fac814336a3c,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2851e97c-31') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2851e97c-31, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52267fd5-83ea-449d-a345-2162eaa37c0e) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:33:54 user nova-compute[74959]: INFO os_vif [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0d:c6,bridge_name='br-int',has_traffic_filtering=True,id=2851e97c-3103-4434-b649-fac814336a3c,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2851e97c-31')
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPEpvQzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:33:54 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b5f92-75f9-41bd-812c-d5504f53363f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:33:54 user nova-compute[74959]: No targets found.
Nov 28 23:33:54 user nova-compute[74959]: iSNS:
Nov 28 23:33:54 user nova-compute[74959]: No targets found.
Nov 28 23:33:54 user nova-compute[74959]: STATIC:
Nov 28 23:33:54 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564
Nov 28 23:33:54 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:33:54 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:33:54 user nova-compute[74959]: FIRMWARE:
Nov 28 23:33:54 user nova-compute[74959]: No targets found.
Nov 28 23:33:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:33:54 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:33:54 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dbb493-025f-414f-a65b-cb9e70e9b686]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[234c5661-6b61-40f3-bfe5-d4043ed172d4]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:33:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:33:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc4ce440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1dfacd-aecb-4112-a891-522b263418e5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9670f-c3da-4a89-9b18-0a74d72ac3ee]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f27247-5ea9-4a35-83c1-878858bb266c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[944a5221-1b82-4069-a180-27dedfe7f6d5]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23933313133376630', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3e6d65cd', '/dev/disk/by-id/scsi-1SCST_BIO3e6d65cd-931137f02edb518a') {{(pid=86637) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b304cb4-cd57-4047-92e5-66489167e872]: (4, None) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee9cf1a-9476-47ab-85b9-fabf87f33023]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5086aacd-381f-434e-8254-1c034aa4fc5f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260]
Nov 28 23:33:54 user nova-compute[74959]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260] successful.
Nov 28 23:33:54 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a891a9e6-f28a-4223-b00f-0b0f43f85855]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== disconnect_volume: return (315ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:33:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:33:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Deleting instance files /opt/stack/data/nova/instances/99905904-3c0f-44ed-adb9-265776616ea4_del
Nov 28 23:33:54 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Deletion of /opt/stack/data/nova/instances/99905904-3c0f-44ed-adb9-265776616ea4_del complete
Nov 28 23:33:55 user nova-compute[74959]: INFO nova.compute.manager [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 23:33:55 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:33:55 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:33:55 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:33:55 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:33:55 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Took 0.68 seconds to deallocate network for instance.
Nov 28 23:33:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-b65e805b-07ba-4625-be73-6b70d23ca943 req-6867781b-e5a9-4688-8e3c-09932dee1021 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received event network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:33:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b65e805b-07ba-4625-be73-6b70d23ca943 req-6867781b-e5a9-4688-8e3c-09932dee1021 service nova] Acquiring lock "99905904-3c0f-44ed-adb9-265776616ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:33:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b65e805b-07ba-4625-be73-6b70d23ca943 req-6867781b-e5a9-4688-8e3c-09932dee1021 service nova] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:33:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b65e805b-07ba-4625-be73-6b70d23ca943 req-6867781b-e5a9-4688-8e3c-09932dee1021 service nova] Lock "99905904-3c0f-44ed-adb9-265776616ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:33:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-b65e805b-07ba-4625-be73-6b70d23ca943 req-6867781b-e5a9-4688-8e3c-09932dee1021 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] No waiting events found dispatching network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:33:56 user nova-compute[74959]: WARNING nova.compute.manager [req-b65e805b-07ba-4625-be73-6b70d23ca943 req-6867781b-e5a9-4688-8e3c-09932dee1021 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received unexpected event network-vif-plugged-2851e97c-3103-4434-b649-fac814336a3c for instance with vm_state active and task_state deleting.
Nov 28 23:33:56 user nova-compute[74959]: DEBUG nova.compute.manager [req-b65e805b-07ba-4625-be73-6b70d23ca943 req-6867781b-e5a9-4688-8e3c-09932dee1021 service nova] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Received event network-vif-deleted-2851e97c-3103-4434-b649-fac814336a3c {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:33:56 user nova-compute[74959]: INFO nova.compute.manager [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 99905904-3c0f-44ed-adb9-265776616ea4] Took 0.81 seconds to detach 1 volumes for instance.
Nov 28 23:33:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:33:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:33:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:33:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:33:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:33:56 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Deleted allocations for instance 99905904-3c0f-44ed-adb9-265776616ea4
Nov 28 23:33:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-beb6cab8-ad38-472c-8a26-68117ae66d58 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "99905904-3c0f-44ed-adb9-265776616ea4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.968s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:33:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:33:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:34:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:34:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:34:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:14 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:34:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:34:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.09465789794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:34:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify base images {{(pid=74959) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Image id dd44e43d-57fb-483e-b625-10657e7fc425 yields fingerprint 61bcca3c9d5b447059bb73dbf5df042035919cd8 {{(pid=74959) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] image dd44e43d-57fb-483e-b625-10657e7fc425 at (/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8): checking
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] image dd44e43d-57fb-483e-b625-10657e7fc425 at (/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8): image is in use {{(pid=74959) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74959) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 is a valid instance name {{(pid=74959) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 has a disk file {{(pid=74959) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 is backed by 61bcca3c9d5b447059bb73dbf5df042035919cd8 {{(pid=74959) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc
Nov 28 23:34:30 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Active base files: /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Removable base files: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49 /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308 /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69 /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc
Nov 28 23:34:30 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verification complete {{(pid=74959) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify swap images {{(pid=74959) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 23:34:30 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify ephemeral images {{(pid=74959) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 23:34:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:34:45 user nova-compute[74959]: INFO nova.compute.claims [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Claim successful on node user
Nov 28 23:34:45 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:34:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:34:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:34:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:34:46 user nova-compute[74959]: INFO nova.virt.block_device [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Booting with volume 0a69edf1-b0fc-41b7-bc82-95c8df7fd564 at /dev/vda
Nov 28 23:34:46 user nova-compute[74959]: DEBUG nova.policy [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '762e77e638ee4789a04c58868648d0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b91fdb847ce9aefc26052b7e87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[68050d23-abbd-48ad-b334-98e2384c6588]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d8a7e1-0fe5-4eda-94f9-ec88d6bcfb28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3712b9-086f-4851-a2fa-016ac5ffd572]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f6b9ff-cee4-4dd5-b34b-57f36af19c46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:34:46 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:34:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb1df37-9979-4c37-bc28-ac0e5c3eeaee]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating existing volume attachment record: 0cb624a9-4191-4779-af49-23e21bd44af3 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:34:46 user nova-compute[74959]: DEBUG nova.network.neutron [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Successfully created port: 4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Successfully updated port: 4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquired lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-fa9789e2-6f75-4291-ab11-ff7457ab0667 req-ca718347-edca-44e5-b366-489ad1b8c1f6 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-changed-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-fa9789e2-6f75-4291-ab11-ff7457ab0667 req-ca718347-edca-44e5-b366-489ad1b8c1f6 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Refreshing instance network info cache due to event network-changed-4870b782-3a5c-4a53-b8e3-a80377cd8044. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fa9789e2-6f75-4291-ab11-ff7457ab0667 req-ca718347-edca-44e5-b366-489ad1b8c1f6 service nova] Acquiring lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:34:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:34:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Releasing lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:34:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Instance network_info: |[{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:34:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fa9789e2-6f75-4291-ab11-ff7457ab0667 req-ca718347-edca-44e5-b366-489ad1b8c1f6 service nova] Acquired lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:34:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-fa9789e2-6f75-4291-ab11-ff7457ab0667 req-ca718347-edca-44e5-b366-489ad1b8c1f6 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Refreshing network info cache for port 4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:34:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-fa9789e2-6f75-4291-ab11-ff7457ab0667 req-ca718347-edca-44e5-b366-489ad1b8c1f6 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updated VIF entry in instance network info cache for port 4870b782-3a5c-4a53-b8e3-a80377cd8044. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:34:48 user nova-compute[74959]: DEBUG nova.network.neutron [req-fa9789e2-6f75-4291-ab11-ff7457ab0667 req-ca718347-edca-44e5-b366-489ad1b8c1f6 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:34:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fa9789e2-6f75-4291-ab11-ff7457ab0667 req-ca718347-edca-44e5-b366-489ad1b8c1f6 service nova] Releasing lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:34:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:34:53 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Creating image(s)
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Ensure instance console log exists: /opt/stack/data/nova/instances/fd356d7f-cabd-4432-a69c-63f56aa6f6d8/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Start _get_guest_xml network_info=[{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPEpvQzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd356d7f-cabd-4432-a69c-63f56aa6f6d8', 'attached_at': '', 'detached_at': '', 'volume_id': '0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'serial': '0a69edf1-b0fc-41b7-bc82-95c8df7fd564'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '0cb624a9-4191-4779-af49-23e21bd44af3', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:34:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:34:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPEpvQzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:34:53 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:34:53 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:34:53 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[916e299f-fb35-45eb-a6d7-b7e460ffaae6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:34:53 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c677d64c-6bfe-4785-a74c-09d0ff70c886]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564] added
Nov 28 23:34:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c05244-6f1f-45c5-96f6-4cbc69f51744]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d83c6b-d4e1-46f9-bd66-27d3281de988]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPEpvQzl {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPEpvQzl" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[abac33fa-49a1-4bbf-b1fa-3beb9045a3da]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wPEpvQzl'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[277faeb4-eff0-4f7b-987e-7acac6e63e3a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d977cd0-1073-4927-9008-93de6aec1fe1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:34:53 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:34:53 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:34:53 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:34:53 user nova-compute[74959]: 
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd808948-2657-4df4-b75c-32b7f0623271]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260]
Nov 28 23:34:53 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260] successful.
Nov 28 23:34:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8860eda2-058e-4724-bafb-50f64dd860e5]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aa1e4f-80d8-4230-af69-cd6e007f1a69]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:34:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:34:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80aa8a1-5121-460c-9652-4fc10d0e6148]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:34:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPEpvQzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23933313133376630', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933313133376630', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1325279504',display_name='tempest-TestVolumeBootPattern-server-1325279504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1325279504',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-7vw00yhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:34:46Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=fd356d7f-cabd-4432-a69c-63f56aa6f6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:2c:55,bridge_name='br-int',has_traffic_filtering=True,id=4870b782-3a5c-4a53-b8e3-a80377cd8044,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4870b782-3a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'pci_devices' on Instance uuid fd356d7f-cabd-4432-a69c-63f56aa6f6d8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:34:54 user nova-compute[74959]:   <uuid>fd356d7f-cabd-4432-a69c-63f56aa6f6d8</uuid>
Nov 28 23:34:54 user nova-compute[74959]:   <name>instance-00000033</name>
Nov 28 23:34:54 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:34:54 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:34:54 user nova-compute[74959]:   <metadata>
Nov 28 23:34:54 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:34:54 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:34:54 user nova-compute[74959]:       <nova:name>tempest-TestVolumeBootPattern-server-1325279504</nova:name>
Nov 28 23:34:54 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:34:53</nova:creationTime>
Nov 28 23:34:54 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:34:54 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:34:54 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:34:54 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:34:54 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:34:54 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:34:54 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:34:54 user nova-compute[74959]:       <nova:owner>
Nov 28 23:34:54 user nova-compute[74959]:         <nova:user uuid="762e77e638ee4789a04c58868648d0a0">tempest-TestVolumeBootPattern-1296185511-project-member</nova:user>
Nov 28 23:34:54 user nova-compute[74959]:         <nova:project uuid="1e1c6b91fdb847ce9aefc26052b7e87c">tempest-TestVolumeBootPattern-1296185511</nova:project>
Nov 28 23:34:54 user nova-compute[74959]:       </nova:owner>
Nov 28 23:34:54 user nova-compute[74959]:       <nova:ports>
Nov 28 23:34:54 user nova-compute[74959]:         <nova:port uuid="4870b782-3a5c-4a53-b8e3-a80377cd8044">
Nov 28 23:34:54 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 23:34:54 user nova-compute[74959]:         </nova:port>
Nov 28 23:34:54 user nova-compute[74959]:       </nova:ports>
Nov 28 23:34:54 user nova-compute[74959]:     </nova:instance>
Nov 28 23:34:54 user nova-compute[74959]:   </metadata>
Nov 28 23:34:54 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:34:54 user nova-compute[74959]:     <system>
Nov 28 23:34:54 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:34:54 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:34:54 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:34:54 user nova-compute[74959]:       <entry name="serial">fd356d7f-cabd-4432-a69c-63f56aa6f6d8</entry>
Nov 28 23:34:54 user nova-compute[74959]:       <entry name="uuid">fd356d7f-cabd-4432-a69c-63f56aa6f6d8</entry>
Nov 28 23:34:54 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:34:54 user nova-compute[74959]:     </system>
Nov 28 23:34:54 user nova-compute[74959]:   </sysinfo>
Nov 28 23:34:54 user nova-compute[74959]:   <os>
Nov 28 23:34:54 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:34:54 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:34:54 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:34:54 user nova-compute[74959]:   </os>
Nov 28 23:34:54 user nova-compute[74959]:   <features>
Nov 28 23:34:54 user nova-compute[74959]:     <acpi/>
Nov 28 23:34:54 user nova-compute[74959]:     <apic/>
Nov 28 23:34:54 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:34:54 user nova-compute[74959]:   </features>
Nov 28 23:34:54 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:34:54 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:34:54 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:34:54 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:34:54 user nova-compute[74959]:   </clock>
Nov 28 23:34:54 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:34:54 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:34:54 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:34:54 user nova-compute[74959]:   </cpu>
Nov 28 23:34:54 user nova-compute[74959]:   <devices>
Nov 28 23:34:54 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:34:54 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:34:54 user nova-compute[74959]:       <source dev="/dev/sdb"/>
Nov 28 23:34:54 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:34:54 user nova-compute[74959]:       <serial>0a69edf1-b0fc-41b7-bc82-95c8df7fd564</serial>
Nov 28 23:34:54 user nova-compute[74959]:     </disk>
Nov 28 23:34:54 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:34:54 user nova-compute[74959]:       <mac address="fa:16:3e:87:2c:55"/>
Nov 28 23:34:54 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:34:54 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:34:54 user nova-compute[74959]:       <target dev="tap4870b782-3a"/>
Nov 28 23:34:54 user nova-compute[74959]:     </interface>
Nov 28 23:34:54 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:34:54 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/fd356d7f-cabd-4432-a69c-63f56aa6f6d8/console.log" append="off"/>
Nov 28 23:34:54 user nova-compute[74959]:     </serial>
Nov 28 23:34:54 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:34:54 user nova-compute[74959]:     <video>
Nov 28 23:34:54 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:34:54 user nova-compute[74959]:     </video>
Nov 28 23:34:54 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:34:54 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:34:54 user nova-compute[74959]:     </rng>
Nov 28 23:34:54 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:34:54 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:34:54 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:34:54 user nova-compute[74959]:     </memballoon>
Nov 28 23:34:54 user nova-compute[74959]:   </devices>
Nov 28 23:34:54 user nova-compute[74959]: </domain>
Nov 28 23:34:54 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1325279504',display_name='tempest-TestVolumeBootPattern-server-1325279504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1325279504',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-7vw00yhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:34:46Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=fd356d7f-cabd-4432-a69c-63f56aa6f6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:2c:55,bridge_name='br-int',has_traffic_filtering=True,id=4870b782-3a5c-4a53-b8e3-a80377cd8044,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4870b782-3a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG os_vif [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:2c:55,bridge_name='br-int',has_traffic_filtering=True,id=4870b782-3a5c-4a53-b8e3-a80377cd8044,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4870b782-3a') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5deae8e4-b77b-5aa6-9fc1-58175216d963', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4870b782-3a, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4870b782-3a, col_values=(('qos', UUID('dae36fb1-ef0e-4684-8dc4-27ef845bbd7e')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4870b782-3a, col_values=(('external_ids', {'iface-id': '4870b782-3a5c-4a53-b8e3-a80377cd8044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:2c:55', 'vm-uuid': 'fd356d7f-cabd-4432-a69c-63f56aa6f6d8'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:54 user nova-compute[74959]: INFO os_vif [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:2c:55,bridge_name='br-int',has_traffic_filtering=True,id=4870b782-3a5c-4a53-b8e3-a80377cd8044,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4870b782-3a')
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:34:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No VIF found with MAC fa:16:3e:87:2c:55, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:34:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-1ae79429-8bb7-4736-af98-736abf337dfb req-ef999cae-6fca-4e4d-b284-a1c489b45493 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:34:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ae79429-8bb7-4736-af98-736abf337dfb req-ef999cae-6fca-4e4d-b284-a1c489b45493 service nova] Acquiring lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ae79429-8bb7-4736-af98-736abf337dfb req-ef999cae-6fca-4e4d-b284-a1c489b45493 service nova] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-1ae79429-8bb7-4736-af98-736abf337dfb req-ef999cae-6fca-4e4d-b284-a1c489b45493 service nova] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-1ae79429-8bb7-4736-af98-736abf337dfb req-ef999cae-6fca-4e4d-b284-a1c489b45493 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] No waiting events found dispatching network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:34:55 user nova-compute[74959]: WARNING nova.compute.manager [req-1ae79429-8bb7-4736-af98-736abf337dfb req-ef999cae-6fca-4e4d-b284-a1c489b45493 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received unexpected event network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 for instance with vm_state building and task_state spawning.
Nov 28 23:34:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:34:57 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Instance spawned successfully.
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:34:57 user nova-compute[74959]: INFO nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 28 23:34:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:34:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-2c575138-0b65-40d9-b674-24813cc07ac4 req-28ef3a3e-69bc-4453-bfbc-809d8e2f541d service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:34:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2c575138-0b65-40d9-b674-24813cc07ac4 req-28ef3a3e-69bc-4453-bfbc-809d8e2f541d service nova] Acquiring lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:34:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2c575138-0b65-40d9-b674-24813cc07ac4 req-28ef3a3e-69bc-4453-bfbc-809d8e2f541d service nova] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:34:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2c575138-0b65-40d9-b674-24813cc07ac4 req-28ef3a3e-69bc-4453-bfbc-809d8e2f541d service nova] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-2c575138-0b65-40d9-b674-24813cc07ac4 req-28ef3a3e-69bc-4453-bfbc-809d8e2f541d service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] No waiting events found dispatching network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:34:58 user nova-compute[74959]: WARNING nova.compute.manager [req-2c575138-0b65-40d9-b674-24813cc07ac4 req-28ef3a3e-69bc-4453-bfbc-809d8e2f541d service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received unexpected event network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 for instance with vm_state building and task_state spawning.
Nov 28 23:34:58 user nova-compute[74959]: INFO nova.compute.manager [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Took 12.47 seconds to build instance.
Nov 28 23:34:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-67c3ed93-1370-47f5-9905-91f259b33205 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.585s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:34:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:34:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:35:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:35:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:35:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:35:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:35:01 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:35:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updating instance_info_cache with network_info: [{"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:35:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:35:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:35:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:35:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:35:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:35:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:35:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:35:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:35:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:35:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:35:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:35:16 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:35:16 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=25.092906951904297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance fd356d7f-cabd-4432-a69c-63f56aa6f6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:35:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:35:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:35:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:35:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:35:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:35:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:35:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:35:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:35:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:35:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:35:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:35:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:35:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:35:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:35:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:35:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:35:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:35:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:35:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:36:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:36:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:36:01 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:36:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:36:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:36:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:36:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:36:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:36:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:36:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:11 user nova-compute[74959]: INFO nova.compute.manager [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Terminating instance
Nov 28 23:36:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-06efdd60-e828-422e-b632-f56118f65a6d req-10399040-6d4e-4283-a3c3-ece0b34f1513 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received event network-vif-unplugged-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06efdd60-e828-422e-b632-f56118f65a6d req-10399040-6d4e-4283-a3c3-ece0b34f1513 service nova] Acquiring lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06efdd60-e828-422e-b632-f56118f65a6d req-10399040-6d4e-4283-a3c3-ece0b34f1513 service nova] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-06efdd60-e828-422e-b632-f56118f65a6d req-10399040-6d4e-4283-a3c3-ece0b34f1513 service nova] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-06efdd60-e828-422e-b632-f56118f65a6d req-10399040-6d4e-4283-a3c3-ece0b34f1513 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] No waiting events found dispatching network-vif-unplugged-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:36:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-06efdd60-e828-422e-b632-f56118f65a6d req-10399040-6d4e-4283-a3c3-ece0b34f1513 service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received event network-vif-unplugged-e2aa6b0e-ef11-4876-9c30-df553acda824 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Instance destroyed successfully.
Nov 28 23:36:12 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lazy-loading 'resources' on Instance uuid b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1401087175',display_name='tempest-ServersNegativeTestJSON-server-1401087175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1401087175',id=47,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:27:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c298516145a14889933df60fb41a7dfb',ramdisk_id='',reservation_id='r-3d0u6jjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1823254971',owner_user_name='tempest-ServersNegativeTestJSON-1823254971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:27:33Z,user_data=None,user_id='d66a584198ab4b35bde53ddc47f412ba',uuid=b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converting VIF {"id": "e2aa6b0e-ef11-4876-9c30-df553acda824", "address": "fa:16:3e:21:8e:82", "network": {"id": "789a8249-6c89-403c-8bc1-5708841d72ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1952783648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c298516145a14889933df60fb41a7dfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aa6b0e-ef", "ovs_interfaceid": "e2aa6b0e-ef11-4876-9c30-df553acda824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:8e:82,bridge_name='br-int',has_traffic_filtering=True,id=e2aa6b0e-ef11-4876-9c30-df553acda824,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aa6b0e-ef') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG os_vif [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:8e:82,bridge_name='br-int',has_traffic_filtering=True,id=e2aa6b0e-ef11-4876-9c30-df553acda824,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aa6b0e-ef') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2aa6b0e-ef, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42581fa5-f008-4f0e-998e-143b61b62158) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:12 user nova-compute[74959]: INFO os_vif [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:8e:82,bridge_name='br-int',has_traffic_filtering=True,id=e2aa6b0e-ef11-4876-9c30-df553acda824,network=Network(789a8249-6c89-403c-8bc1-5708841d72ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aa6b0e-ef')
Nov 28 23:36:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Deleting instance files /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7_del
Nov 28 23:36:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Deletion of /opt/stack/data/nova/instances/b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7_del complete
Nov 28 23:36:12 user nova-compute[74959]: INFO nova.compute.manager [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 23:36:12 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:36:12 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:36:13 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Took 0.53 seconds to deallocate network for instance.
Nov 28 23:36:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:13 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Deleted allocations for instance b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7
Nov 28 23:36:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f948cef9-42e0-4ef6-8c2a-e54f5fd48ed8 tempest-ServersNegativeTestJSON-1823254971 tempest-ServersNegativeTestJSON-1823254971-project-member] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.769s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-07a899d9-c9e4-49df-9ac8-db5de5530e46 req-0b4faa44-63ab-4c99-b678-b0c383460d5d service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received event network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-07a899d9-c9e4-49df-9ac8-db5de5530e46 req-0b4faa44-63ab-4c99-b678-b0c383460d5d service nova] Acquiring lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-07a899d9-c9e4-49df-9ac8-db5de5530e46 req-0b4faa44-63ab-4c99-b678-b0c383460d5d service nova] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-07a899d9-c9e4-49df-9ac8-db5de5530e46 req-0b4faa44-63ab-4c99-b678-b0c383460d5d service nova] Lock "b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-07a899d9-c9e4-49df-9ac8-db5de5530e46 req-0b4faa44-63ab-4c99-b678-b0c383460d5d service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] No waiting events found dispatching network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:36:13 user nova-compute[74959]: WARNING nova.compute.manager [req-07a899d9-c9e4-49df-9ac8-db5de5530e46 req-0b4faa44-63ab-4c99-b678-b0c383460d5d service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received unexpected event network-vif-plugged-e2aa6b0e-ef11-4876-9c30-df553acda824 for instance with vm_state deleted and task_state None.
Nov 28 23:36:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-07a899d9-c9e4-49df-9ac8-db5de5530e46 req-0b4faa44-63ab-4c99-b678-b0c383460d5d service nova] [instance: b70ebf9a-22a3-4f72-b73d-35ac29bf2ea7] Received event network-vif-deleted-e2aa6b0e-ef11-4876-9c30-df553acda824 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:36:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:36:17 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:36:17 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:36:17 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=25.11988067626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance fd356d7f-cabd-4432-a69c-63f56aa6f6d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:36:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:36:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:36:18 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:36:18 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:36:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:36:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-07f3dd6f-4915-4198-ac6d-5a6112fe4562 req-e416aaa6-eaf0-4879-9366-98ab650873a8 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-changed-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:36:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-07f3dd6f-4915-4198-ac6d-5a6112fe4562 req-e416aaa6-eaf0-4879-9366-98ab650873a8 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Refreshing instance network info cache due to event network-changed-4870b782-3a5c-4a53-b8e3-a80377cd8044. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:36:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-07f3dd6f-4915-4198-ac6d-5a6112fe4562 req-e416aaa6-eaf0-4879-9366-98ab650873a8 service nova] Acquiring lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:36:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-07f3dd6f-4915-4198-ac6d-5a6112fe4562 req-e416aaa6-eaf0-4879-9366-98ab650873a8 service nova] Acquired lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:36:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-07f3dd6f-4915-4198-ac6d-5a6112fe4562 req-e416aaa6-eaf0-4879-9366-98ab650873a8 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Refreshing network info cache for port 4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:36:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-07f3dd6f-4915-4198-ac6d-5a6112fe4562 req-e416aaa6-eaf0-4879-9366-98ab650873a8 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updated VIF entry in instance network info cache for port 4870b782-3a5c-4a53-b8e3-a80377cd8044. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:36:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-07f3dd6f-4915-4198-ac6d-5a6112fe4562 req-e416aaa6-eaf0-4879-9366-98ab650873a8 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:36:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-07f3dd6f-4915-4198-ac6d-5a6112fe4562 req-e416aaa6-eaf0-4879-9366-98ab650873a8 service nova] Releasing lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:36:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:36:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid fd356d7f-cabd-4432-a69c-63f56aa6f6d8 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:36:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:36:45 user nova-compute[74959]: INFO nova.compute.claims [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Claim successful on node user
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:36:45 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:36:45 user nova-compute[74959]: DEBUG nova.policy [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '762e77e638ee4789a04c58868648d0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e1c6b91fdb847ce9aefc26052b7e87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:36:45 user nova-compute[74959]: INFO nova.virt.block_device [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Booting with volume f03b58f4-e2a9-4c97-8d89-8df01c368dfd at /dev/vda
Nov 28 23:36:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[658da99e-5c3f-4f52-8ef1-4b58af577f6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ca95ad-7d69-49bf-9531-c082b7a273a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5289a32d-b8c1-458d-a647-9207837696af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a14ab91-6c25-4425-8216-bae124be02e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:36:46 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:36:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbaba1e-b8a7-44f7-a97e-0b172dbbc572]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updating existing volume attachment record: 44d618c9-345e-40db-9a60-be1937d4c277 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:36:46 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Successfully created port: 92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Successfully updated port: 92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquired lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-5de05262-7ceb-489d-b656-b0008092cc25 req-416f45f9-c816-4f56-a5a0-16f4513b4367 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-changed-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.compute.manager [req-5de05262-7ceb-489d-b656-b0008092cc25 req-416f45f9-c816-4f56-a5a0-16f4513b4367 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Refreshing instance network info cache due to event network-changed-92835bb3-882e-4bc9-9610-84930104b213. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5de05262-7ceb-489d-b656-b0008092cc25 req-416f45f9-c816-4f56-a5a0-16f4513b4367 service nova] Acquiring lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.network.neutron [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updating instance_info_cache with network_info: [{"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Releasing lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Instance network_info: |[{"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5de05262-7ceb-489d-b656-b0008092cc25 req-416f45f9-c816-4f56-a5a0-16f4513b4367 service nova] Acquired lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.network.neutron [req-5de05262-7ceb-489d-b656-b0008092cc25 req-416f45f9-c816-4f56-a5a0-16f4513b4367 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Refreshing network info cache for port 92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.network.neutron [req-5de05262-7ceb-489d-b656-b0008092cc25 req-416f45f9-c816-4f56-a5a0-16f4513b4367 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updated VIF entry in instance network info cache for port 92835bb3-882e-4bc9-9610-84930104b213. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:36:47 user nova-compute[74959]: DEBUG nova.network.neutron [req-5de05262-7ceb-489d-b656-b0008092cc25 req-416f45f9-c816-4f56-a5a0-16f4513b4367 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updating instance_info_cache with network_info: [{"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:36:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-5de05262-7ceb-489d-b656-b0008092cc25 req-416f45f9-c816-4f56-a5a0-16f4513b4367 service nova] Releasing lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:36:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:36:53 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Creating image(s)
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Did not create local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Ensure instance console log exists: /opt/stack/data/nova/instances/8c81e6fa-c616-4fcd-bf95-393dbf7eafb6/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Start _get_guest_xml network_info=[{"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvCAxdOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c81e6fa-c616-4fcd-bf95-393dbf7eafb6', 'attached_at': '', 'detached_at': '', 'volume_id': 'f03b58f4-e2a9-4c97-8d89-8df01c368dfd', 'serial': 'f03b58f4-e2a9-4c97-8d89-8df01c368dfd'}, 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '44d618c9-345e-40db-9a60-be1937d4c277', 'device_type': 'disk', 'volume_type': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:36:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:36:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvCAxdOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:36:53 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:36:53 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:36:53 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7e14e3-ef25-4675-9556-dbfc4cf9ec66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:36:53 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b74da6-ae56-4573-8a6a-4d42b33645a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd] added
Nov 28 23:36:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a1762-6654-4143-b92c-cc425eae7282]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec07c6-7b5c-4c08-ba25-b4d94cc8fda8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvCAxdOI {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvCAxdOI" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a411df18-6166-4e8e-a8f9-8e88de092afe]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvCAxdOI'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a566b-b0fe-4482-b899-d8c9e79cac69]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec28281-8d76-4cf7-b4eb-e9647fa6f50c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:36:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:36:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b9406-365e-4b94-aa9f-fff494039176]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd, portal: 172.16.0.220,3260]
Nov 28 23:36:53 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd, portal: 172.16.0.220,3260] successful.
Nov 28 23:36:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[148510b4-1c5f-432f-8b4f-e0e5fbcbdd57]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f01a6ec-20c8-495b-8811-331ba6bf4973]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:36:53 user nova-compute[74959]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd (non-flash)
Nov 28 23:36:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:36:53 user nova-compute[74959]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd (non-flash)
Nov 28 23:36:53 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d91cff3-e1df-4429-be2c-5bd925037a37]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:36:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvCAxdOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26432633861383239', 'path': '/dev/sdc'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432633861383239', 'path': '/dev/sdc'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2061180',display_name='tempest-TestVolumeBootPattern-server-2061180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2061180',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-2gr0hwq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:36:46Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=8c81e6fa-c616-4fcd-bf95-393dbf7eafb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=92835bb3-882e-4bc9-9610-84930104b213,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92835bb3-88') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.objects.instance [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:36:54 user nova-compute[74959]:   <uuid>8c81e6fa-c616-4fcd-bf95-393dbf7eafb6</uuid>
Nov 28 23:36:54 user nova-compute[74959]:   <name>instance-00000034</name>
Nov 28 23:36:54 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:36:54 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:36:54 user nova-compute[74959]:   <metadata>
Nov 28 23:36:54 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:36:54 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:36:54 user nova-compute[74959]:       <nova:name>tempest-TestVolumeBootPattern-server-2061180</nova:name>
Nov 28 23:36:54 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:36:53</nova:creationTime>
Nov 28 23:36:54 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:36:54 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:36:54 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:36:54 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:36:54 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:36:54 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:36:54 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:36:54 user nova-compute[74959]:       <nova:owner>
Nov 28 23:36:54 user nova-compute[74959]:         <nova:user uuid="762e77e638ee4789a04c58868648d0a0">tempest-TestVolumeBootPattern-1296185511-project-member</nova:user>
Nov 28 23:36:54 user nova-compute[74959]:         <nova:project uuid="1e1c6b91fdb847ce9aefc26052b7e87c">tempest-TestVolumeBootPattern-1296185511</nova:project>
Nov 28 23:36:54 user nova-compute[74959]:       </nova:owner>
Nov 28 23:36:54 user nova-compute[74959]:       <nova:ports>
Nov 28 23:36:54 user nova-compute[74959]:         <nova:port uuid="92835bb3-882e-4bc9-9610-84930104b213">
Nov 28 23:36:54 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 23:36:54 user nova-compute[74959]:         </nova:port>
Nov 28 23:36:54 user nova-compute[74959]:       </nova:ports>
Nov 28 23:36:54 user nova-compute[74959]:     </nova:instance>
Nov 28 23:36:54 user nova-compute[74959]:   </metadata>
Nov 28 23:36:54 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:36:54 user nova-compute[74959]:     <system>
Nov 28 23:36:54 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:36:54 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:36:54 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:36:54 user nova-compute[74959]:       <entry name="serial">8c81e6fa-c616-4fcd-bf95-393dbf7eafb6</entry>
Nov 28 23:36:54 user nova-compute[74959]:       <entry name="uuid">8c81e6fa-c616-4fcd-bf95-393dbf7eafb6</entry>
Nov 28 23:36:54 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:36:54 user nova-compute[74959]:     </system>
Nov 28 23:36:54 user nova-compute[74959]:   </sysinfo>
Nov 28 23:36:54 user nova-compute[74959]:   <os>
Nov 28 23:36:54 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:36:54 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:36:54 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:36:54 user nova-compute[74959]:   </os>
Nov 28 23:36:54 user nova-compute[74959]:   <features>
Nov 28 23:36:54 user nova-compute[74959]:     <acpi/>
Nov 28 23:36:54 user nova-compute[74959]:     <apic/>
Nov 28 23:36:54 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:36:54 user nova-compute[74959]:   </features>
Nov 28 23:36:54 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:36:54 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:36:54 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:36:54 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:36:54 user nova-compute[74959]:   </clock>
Nov 28 23:36:54 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:36:54 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:36:54 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:36:54 user nova-compute[74959]:   </cpu>
Nov 28 23:36:54 user nova-compute[74959]:   <devices>
Nov 28 23:36:54 user nova-compute[74959]:     <disk type="block" device="disk">
Nov 28 23:36:54 user nova-compute[74959]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:36:54 user nova-compute[74959]:       <source dev="/dev/sdc"/>
Nov 28 23:36:54 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:36:54 user nova-compute[74959]:       <serial>f03b58f4-e2a9-4c97-8d89-8df01c368dfd</serial>
Nov 28 23:36:54 user nova-compute[74959]:     </disk>
Nov 28 23:36:54 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:36:54 user nova-compute[74959]:       <mac address="fa:16:3e:27:69:b5"/>
Nov 28 23:36:54 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:36:54 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:36:54 user nova-compute[74959]:       <target dev="tap92835bb3-88"/>
Nov 28 23:36:54 user nova-compute[74959]:     </interface>
Nov 28 23:36:54 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:36:54 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/8c81e6fa-c616-4fcd-bf95-393dbf7eafb6/console.log" append="off"/>
Nov 28 23:36:54 user nova-compute[74959]:     </serial>
Nov 28 23:36:54 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:36:54 user nova-compute[74959]:     <video>
Nov 28 23:36:54 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:36:54 user nova-compute[74959]:     </video>
Nov 28 23:36:54 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:36:54 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:36:54 user nova-compute[74959]:     </rng>
Nov 28 23:36:54 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:36:54 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:36:54 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:36:54 user nova-compute[74959]:     </memballoon>
Nov 28 23:36:54 user nova-compute[74959]:   </devices>
Nov 28 23:36:54 user nova-compute[74959]: </domain>
Nov 28 23:36:54 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2061180',display_name='tempest-TestVolumeBootPattern-server-2061180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2061180',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-2gr0hwq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:36:46Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=8c81e6fa-c616-4fcd-bf95-393dbf7eafb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=92835bb3-882e-4bc9-9610-84930104b213,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92835bb3-88') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG os_vif [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=92835bb3-882e-4bc9-9610-84930104b213,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92835bb3-88') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a716363-208c-5806-b1cb-fb528a66e019', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92835bb3-88, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92835bb3-88, col_values=(('qos', UUID('e5e8f7bf-65a2-4025-97ce-74f1526446a3')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92835bb3-88, col_values=(('external_ids', {'iface-id': '92835bb3-882e-4bc9-9610-84930104b213', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:69:b5', 'vm-uuid': '8c81e6fa-c616-4fcd-bf95-393dbf7eafb6'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:54 user nova-compute[74959]: INFO os_vif [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=92835bb3-882e-4bc9-9610-84930104b213,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92835bb3-88')
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:36:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] No VIF found with MAC fa:16:3e:27:69:b5, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:36:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:55 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-b4097345-7cff-48f2-b895-fb7035728d42 req-49003b46-b32b-4998-b95c-787f64380e8a service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:36:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b4097345-7cff-48f2-b895-fb7035728d42 req-49003b46-b32b-4998-b95c-787f64380e8a service nova] Acquiring lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b4097345-7cff-48f2-b895-fb7035728d42 req-49003b46-b32b-4998-b95c-787f64380e8a service nova] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-b4097345-7cff-48f2-b895-fb7035728d42 req-49003b46-b32b-4998-b95c-787f64380e8a service nova] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:55 user nova-compute[74959]: DEBUG nova.compute.manager [req-b4097345-7cff-48f2-b895-fb7035728d42 req-49003b46-b32b-4998-b95c-787f64380e8a service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] No waiting events found dispatching network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:36:55 user nova-compute[74959]: WARNING nova.compute.manager [req-b4097345-7cff-48f2-b895-fb7035728d42 req-49003b46-b32b-4998-b95c-787f64380e8a service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received unexpected event network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 for instance with vm_state building and task_state spawning.
Nov 28 23:36:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:36:57 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Instance spawned successfully.
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:36:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:36:58 user nova-compute[74959]: INFO nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 28 23:36:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:36:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-618137c1-002f-4124-b836-c4e927fc34ba req-fa7cf460-d6ae-42d4-aedc-8496444893f4 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:36:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-618137c1-002f-4124-b836-c4e927fc34ba req-fa7cf460-d6ae-42d4-aedc-8496444893f4 service nova] Acquiring lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:36:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-618137c1-002f-4124-b836-c4e927fc34ba req-fa7cf460-d6ae-42d4-aedc-8496444893f4 service nova] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:36:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-618137c1-002f-4124-b836-c4e927fc34ba req-fa7cf460-d6ae-42d4-aedc-8496444893f4 service nova] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:58 user nova-compute[74959]: DEBUG nova.compute.manager [req-618137c1-002f-4124-b836-c4e927fc34ba req-fa7cf460-d6ae-42d4-aedc-8496444893f4 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] No waiting events found dispatching network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:36:58 user nova-compute[74959]: WARNING nova.compute.manager [req-618137c1-002f-4124-b836-c4e927fc34ba req-fa7cf460-d6ae-42d4-aedc-8496444893f4 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received unexpected event network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 for instance with vm_state building and task_state spawning.
Nov 28 23:36:58 user nova-compute[74959]: INFO nova.compute.manager [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Took 12.54 seconds to build instance.
Nov 28 23:36:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-9987fef8-2301-4ce8-8fc1-7e71a1561f59 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.631s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:36:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:37:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:37:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:37:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:37:02 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:37:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid fd356d7f-cabd-4432-a69c-63f56aa6f6d8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:37:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:37:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:37:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:37:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:05 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:37:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:37:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:37:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:37:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:37:19 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:37:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:37:19 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:37:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:37:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:37:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.117401123046875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance fd356d7f-cabd-4432-a69c-63f56aa6f6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:37:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:37:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:37:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:37:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:37:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:37:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:37:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:37:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:37:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:37:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:37:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:37:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:37:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:37:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:37:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updating instance_info_cache with network_info: [{"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:38:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:38:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:38:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:38:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:38:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:38:21 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:38:21 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:38:21 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.116493225097656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:38:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:38:22 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance fd356d7f-cabd-4432-a69c-63f56aa6f6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:38:22 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:38:22 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:38:22 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:38:22 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:38:22 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:38:22 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:38:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:38:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:38:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:38:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-7e1d47f0-65ee-41e7-97b0-63c97945ad22 req-adfb6ea6-40fe-4886-9182-eded39db6c6e service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-changed-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-7e1d47f0-65ee-41e7-97b0-63c97945ad22 req-adfb6ea6-40fe-4886-9182-eded39db6c6e service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Refreshing instance network info cache due to event network-changed-92835bb3-882e-4bc9-9610-84930104b213. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7e1d47f0-65ee-41e7-97b0-63c97945ad22 req-adfb6ea6-40fe-4886-9182-eded39db6c6e service nova] Acquiring lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7e1d47f0-65ee-41e7-97b0-63c97945ad22 req-adfb6ea6-40fe-4886-9182-eded39db6c6e service nova] Acquired lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-7e1d47f0-65ee-41e7-97b0-63c97945ad22 req-adfb6ea6-40fe-4886-9182-eded39db6c6e service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Refreshing network info cache for port 92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-7e1d47f0-65ee-41e7-97b0-63c97945ad22 req-adfb6ea6-40fe-4886-9182-eded39db6c6e service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updated VIF entry in instance network info cache for port 92835bb3-882e-4bc9-9610-84930104b213. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-7e1d47f0-65ee-41e7-97b0-63c97945ad22 req-adfb6ea6-40fe-4886-9182-eded39db6c6e service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updating instance_info_cache with network_info: [{"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:38:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-7e1d47f0-65ee-41e7-97b0-63c97945ad22 req-adfb6ea6-40fe-4886-9182-eded39db6c6e service nova] Releasing lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:38:38 user nova-compute[74959]: INFO nova.compute.manager [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Terminating instance
Nov 28 23:38:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-18a7aa57-1fc0-40c7-b1c7-606af23ff2e2 req-8a86318b-a534-45e3-9be4-ce3529890832 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-changed-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-18a7aa57-1fc0-40c7-b1c7-606af23ff2e2 req-8a86318b-a534-45e3-9be4-ce3529890832 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Refreshing instance network info cache due to event network-changed-92835bb3-882e-4bc9-9610-84930104b213. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18a7aa57-1fc0-40c7-b1c7-606af23ff2e2 req-8a86318b-a534-45e3-9be4-ce3529890832 service nova] Acquiring lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18a7aa57-1fc0-40c7-b1c7-606af23ff2e2 req-8a86318b-a534-45e3-9be4-ce3529890832 service nova] Acquired lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-18a7aa57-1fc0-40c7-b1c7-606af23ff2e2 req-8a86318b-a534-45e3-9be4-ce3529890832 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Refreshing network info cache for port 92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-18a7aa57-1fc0-40c7-b1c7-606af23ff2e2 req-8a86318b-a534-45e3-9be4-ce3529890832 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updated VIF entry in instance network info cache for port 92835bb3-882e-4bc9-9610-84930104b213. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG nova.network.neutron [req-18a7aa57-1fc0-40c7-b1c7-606af23ff2e2 req-8a86318b-a534-45e3-9be4-ce3529890832 service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updating instance_info_cache with network_info: [{"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-18a7aa57-1fc0-40c7-b1c7-606af23ff2e2 req-8a86318b-a534-45e3-9be4-ce3529890832 service nova] Releasing lock "refresh_cache-8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:38 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Instance destroyed successfully.
Nov 28 23:38:38 user nova-compute[74959]: DEBUG nova.objects.instance [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'resources' on Instance uuid 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2061180',display_name='tempest-TestVolumeBootPattern-server-2061180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2061180',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:36:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-2gr0hwq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:36:58Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=8c81e6fa-c616-4fcd-bf95-393dbf7eafb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "92835bb3-882e-4bc9-9610-84930104b213", "address": "fa:16:3e:27:69:b5", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92835bb3-88", "ovs_interfaceid": "92835bb3-882e-4bc9-9610-84930104b213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=92835bb3-882e-4bc9-9610-84930104b213,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92835bb3-88') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_vif [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=92835bb3-882e-4bc9-9610-84930104b213,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92835bb3-88') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92835bb3-88, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5e8f7bf-65a2-4025-97ce-74f1526446a3) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:39 user nova-compute[74959]: INFO os_vif [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=92835bb3-882e-4bc9-9610-84930104b213,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92835bb3-88')
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvCAxdOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:38:39 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[911fa496-e24c-486e-b96e-6ae26738b8d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:38:39 user nova-compute[74959]: No targets found.
Nov 28 23:38:39 user nova-compute[74959]: iSNS:
Nov 28 23:38:39 user nova-compute[74959]: No targets found.
Nov 28 23:38:39 user nova-compute[74959]: STATIC:
Nov 28 23:38:39 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd
Nov 28 23:38:39 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:38:39 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:38:39 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564
Nov 28 23:38:39 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:38:39 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:38:39 user nova-compute[74959]: FIRMWARE:
Nov 28 23:38:39 user nova-compute[74959]: No targets found.
Nov 28 23:38:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:38:39 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:38:39 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[22182d7d-7f87-4e32-b494-93c18edc9b16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8d9798-759b-4719-9299-604960405b24]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:38:39 user nova-compute[74959]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd (non-flash)
Nov 28 23:38:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:38:39 user nova-compute[74959]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd (non-flash)
Nov 28 23:38:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc555cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd'): ({'sdc'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Removing single pathed devices sdc {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fba8a5-ab28-4993-b58b-98631a94fcbc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[98584bc4-50c5-4832-b7fb-e33672bd64d6]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flushing IO for device /dev/sdc {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a593a17-f276-4fe2-8530-60f73137f76d]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9dbc2a-9b05-441a-8d5e-9f5e52e88de7]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] SCSI volumes sdc have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0176a70d-0936-4ba2-96ff-63e5e40c2957]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fa0187-a182-4f12-b872-bda943969482]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd, portal: 172.16.0.220,3260]
Nov 28 23:38:39 user nova-compute[74959]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd, portal: 172.16.0.220,3260] successful.
Nov 28 23:38:39 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-vif-unplugged-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] Acquiring lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] No waiting events found dispatching network-vif-unplugged-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-vif-unplugged-92835bb3-882e-4bc9-9610-84930104b213 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] Acquiring lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] No waiting events found dispatching network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:38:39 user nova-compute[74959]: WARNING nova.compute.manager [req-0bdc9021-cb73-47ca-a7b9-3cb8c23f09db req-c7aa082e-543b-4669-914f-bfe88c1f562d service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received unexpected event network-vif-plugged-92835bb3-882e-4bc9-9610-84930104b213 for instance with vm_state active and task_state deleting.
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b58f4-e2a9-4c97-8d89-8df01c368dfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba43301-9a5f-4b4c-8449-79c1b7883fe4]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== disconnect_volume: return (323ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:38:39 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Deleting instance files /opt/stack/data/nova/instances/8c81e6fa-c616-4fcd-bf95-393dbf7eafb6_del
Nov 28 23:38:39 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Deletion of /opt/stack/data/nova/instances/8c81e6fa-c616-4fcd-bf95-393dbf7eafb6_del complete
Nov 28 23:38:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:39 user nova-compute[74959]: INFO nova.compute.manager [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 28 23:38:39 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:38:39 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Took 0.40 seconds to deallocate network for instance.
Nov 28 23:38:39 user nova-compute[74959]: DEBUG nova.compute.manager [req-2a9c711c-2884-420f-a9a3-af511485e9c9 req-91339f32-65a9-4984-a484-93b0b16e63ac service nova] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Received event network-vif-deleted-92835bb3-882e-4bc9-9610-84930104b213 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:38:40 user nova-compute[74959]: INFO nova.compute.manager [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6] Took 0.73 seconds to detach 1 volumes for instance.
Nov 28 23:38:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:38:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:38:40 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:38:40 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:38:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:38:40 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Deleted allocations for instance 8c81e6fa-c616-4fcd-bf95-393dbf7eafb6
Nov 28 23:38:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-8755a028-a460-4efc-8bd5-24d987ad69fb tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "8c81e6fa-c616-4fcd-bf95-393dbf7eafb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.694s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:38:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:38:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:38:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:38:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:38:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:38:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid fd356d7f-cabd-4432-a69c-63f56aa6f6d8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:39:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:39:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:39:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:39:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:39:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:39:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:39:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:39:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:39:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:39:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:39:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:39:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:39:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:39:23 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:39:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:39:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:39:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=25.115550994873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance fd356d7f-cabd-4432-a69c-63f56aa6f6d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:39:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:39:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:39:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.compute.manager [req-e867125b-8da2-472c-944e-e5dbc8f81bf0 req-1d9c5735-21ee-4683-b0fa-e12aaf21fc3c service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-changed-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.compute.manager [req-e867125b-8da2-472c-944e-e5dbc8f81bf0 req-1d9c5735-21ee-4683-b0fa-e12aaf21fc3c service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Refreshing instance network info cache due to event network-changed-4870b782-3a5c-4a53-b8e3-a80377cd8044. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e867125b-8da2-472c-944e-e5dbc8f81bf0 req-1d9c5735-21ee-4683-b0fa-e12aaf21fc3c service nova] Acquiring lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e867125b-8da2-472c-944e-e5dbc8f81bf0 req-1d9c5735-21ee-4683-b0fa-e12aaf21fc3c service nova] Acquired lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-e867125b-8da2-472c-944e-e5dbc8f81bf0 req-1d9c5735-21ee-4683-b0fa-e12aaf21fc3c service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Refreshing network info cache for port 4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:39:36 user nova-compute[74959]: INFO nova.compute.manager [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Terminating instance
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.compute.manager [req-637bfb94-300c-4a2e-8fbc-7c2042757874 req-7fc308b0-30f7-4cad-a46d-98ecf8cb30c7 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-vif-unplugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-637bfb94-300c-4a2e-8fbc-7c2042757874 req-7fc308b0-30f7-4cad-a46d-98ecf8cb30c7 service nova] Acquiring lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-637bfb94-300c-4a2e-8fbc-7c2042757874 req-7fc308b0-30f7-4cad-a46d-98ecf8cb30c7 service nova] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-637bfb94-300c-4a2e-8fbc-7c2042757874 req-7fc308b0-30f7-4cad-a46d-98ecf8cb30c7 service nova] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.compute.manager [req-637bfb94-300c-4a2e-8fbc-7c2042757874 req-7fc308b0-30f7-4cad-a46d-98ecf8cb30c7 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] No waiting events found dispatching network-vif-unplugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.compute.manager [req-637bfb94-300c-4a2e-8fbc-7c2042757874 req-7fc308b0-30f7-4cad-a46d-98ecf8cb30c7 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-vif-unplugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-e867125b-8da2-472c-944e-e5dbc8f81bf0 req-1d9c5735-21ee-4683-b0fa-e12aaf21fc3c service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updated VIF entry in instance network info cache for port 4870b782-3a5c-4a53-b8e3-a80377cd8044. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.network.neutron [req-e867125b-8da2-472c-944e-e5dbc8f81bf0 req-1d9c5735-21ee-4683-b0fa-e12aaf21fc3c service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [{"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-e867125b-8da2-472c-944e-e5dbc8f81bf0 req-1d9c5735-21ee-4683-b0fa-e12aaf21fc3c service nova] Releasing lock "refresh_cache-fd356d7f-cabd-4432-a69c-63f56aa6f6d8" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Instance destroyed successfully.
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.objects.instance [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lazy-loading 'resources' on Instance uuid fd356d7f-cabd-4432-a69c-63f56aa6f6d8 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1325279504',display_name='tempest-TestVolumeBootPattern-server-1325279504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1325279504',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGQdD4mEq2MJo4CIKvaWrwb4UrLJ/XNA9bGCcTZaqXSYwh7w3Q8nn53Vj85b4AGi58sIudWKvLKPySNhbphCsdI4aDy8x4fWqrP/Mi/3QF4oYElrgXouBzspMUD6vAbRw==',key_name='tempest-TestVolumeBootPattern-412317',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:34:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e1c6b91fdb847ce9aefc26052b7e87c',ramdisk_id='',reservation_id='r-7vw00yhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1296185511',owner_user_name='tempest-TestVolumeBootPattern-1296185511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:34:58Z,user_data=None,user_id='762e77e638ee4789a04c58868648d0a0',uuid=fd356d7f-cabd-4432-a69c-63f56aa6f6d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converting VIF {"id": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "address": "fa:16:3e:87:2c:55", "network": {"id": "a7381952-ef6f-4f15-a412-e0116a3ad89f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2014012877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e1c6b91fdb847ce9aefc26052b7e87c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4870b782-3a", "ovs_interfaceid": "4870b782-3a5c-4a53-b8e3-a80377cd8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:2c:55,bridge_name='br-int',has_traffic_filtering=True,id=4870b782-3a5c-4a53-b8e3-a80377cd8044,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4870b782-3a') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG os_vif [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:2c:55,bridge_name='br-int',has_traffic_filtering=True,id=4870b782-3a5c-4a53-b8e3-a80377cd8044,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4870b782-3a') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4870b782-3a, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dae36fb1-ef0e-4684-8dc4-27ef845bbd7e) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:39:36 user nova-compute[74959]: INFO os_vif [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:2c:55,bridge_name='br-int',has_traffic_filtering=True,id=4870b782-3a5c-4a53-b8e3-a80377cd8044,network=Network(a7381952-ef6f-4f15-a412-e0116a3ad89f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4870b782-3a')
Nov 28 23:39:36 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPEpvQzl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:39:36 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:39:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[66799474-6445-4e26-8a0f-3573185f6a17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:39:36 user nova-compute[74959]: No targets found.
Nov 28 23:39:36 user nova-compute[74959]: iSNS:
Nov 28 23:39:36 user nova-compute[74959]: No targets found.
Nov 28 23:39:36 user nova-compute[74959]: STATIC:
Nov 28 23:39:36 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564
Nov 28 23:39:36 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:39:36 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:39:36 user nova-compute[74959]: FIRMWARE:
Nov 28 23:39:36 user nova-compute[74959]: No targets found.
Nov 28 23:39:36 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:39:36 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:39:36 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:39:36 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cc1ec6-4c16-49e6-8308-3299b030ec85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf1f852-f750-4ddf-9c6e-3d397c40d62e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:39:37 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 (non-flash)
Nov 28 23:39:37 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc439c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9fc235-07b3-492f-a174-e5fcf1076bf8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[286d10ec-9f38-4a17-9820-b4deed89cedd]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2831f452-4b88-4e29-afd2-230fd1402030]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7715a7-87a4-49e1-98d3-a2425486e8d5]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23933313133376630', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3e6d65cd', '/dev/disk/by-id/scsi-1SCST_BIO3e6d65cd-931137f02edb518a') {{(pid=86637) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 23:39:37 user nova-compute[74959]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23933313133376630
Nov 28 23:39:37 user nova-compute[74959]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_3e6d65cd
Nov 28 23:39:37 user nova-compute[74959]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO3e6d65cd-931137f02edb518a
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[929aad3b-955c-4cbb-ac7c-36e41e06a8a9]: (4, None) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b460070a-2a3b-4b67-9356-fe92ba3a54cc]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa9290a-fd23-4278-a14e-8c5d7c2bf4ae]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260]
Nov 28 23:39:37 user nova-compute[74959]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564, portal: 172.16.0.220,3260] successful.
Nov 28 23:39:37 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a69edf1-b0fc-41b7-bc82-95c8df7fd564 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52b6d0e-5d87-4f50-a7ca-7b004e07731a]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] <== disconnect_volume: return (308ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:39:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Deleting instance files /opt/stack/data/nova/instances/fd356d7f-cabd-4432-a69c-63f56aa6f6d8_del
Nov 28 23:39:37 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Deletion of /opt/stack/data/nova/instances/fd356d7f-cabd-4432-a69c-63f56aa6f6d8_del complete
Nov 28 23:39:37 user nova-compute[74959]: INFO nova.compute.manager [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 23:39:37 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:39:37 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Took 0.50 seconds to deallocate network for instance.
Nov 28 23:39:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-e5e03445-d26a-446d-a4fa-6ccdd905896c req-bbf2fb4c-a95b-42fd-b6ce-5a29e9b0cfe3 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-vif-deleted-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:39:37 user nova-compute[74959]: INFO nova.compute.manager [req-e5e03445-d26a-446d-a4fa-6ccdd905896c req-bbf2fb4c-a95b-42fd-b6ce-5a29e9b0cfe3 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Neutron deleted interface 4870b782-3a5c-4a53-b8e3-a80377cd8044; detaching it from the instance and deleting it from the info cache
Nov 28 23:39:37 user nova-compute[74959]: DEBUG nova.network.neutron [req-e5e03445-d26a-446d-a4fa-6ccdd905896c req-bbf2fb4c-a95b-42fd-b6ce-5a29e9b0cfe3 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:39:37 user nova-compute[74959]: DEBUG nova.compute.manager [req-e5e03445-d26a-446d-a4fa-6ccdd905896c req-bbf2fb4c-a95b-42fd-b6ce-5a29e9b0cfe3 service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Detach interface failed, port_id=4870b782-3a5c-4a53-b8e3-a80377cd8044, reason: Instance fd356d7f-cabd-4432-a69c-63f56aa6f6d8 could not be found. {{(pid=74959) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 23:39:38 user nova-compute[74959]: INFO nova.compute.manager [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Took 0.73 seconds to detach 1 volumes for instance.
Nov 28 23:39:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-3a8d519c-220c-4379-a35e-b856780bb42e req-e00910c4-0b16-4b67-9cdc-971ecb149bdd service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received event network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:39:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3a8d519c-220c-4379-a35e-b856780bb42e req-e00910c4-0b16-4b67-9cdc-971ecb149bdd service nova] Acquiring lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:39:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3a8d519c-220c-4379-a35e-b856780bb42e req-e00910c4-0b16-4b67-9cdc-971ecb149bdd service nova] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:39:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-3a8d519c-220c-4379-a35e-b856780bb42e req-e00910c4-0b16-4b67-9cdc-971ecb149bdd service nova] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:39:38 user nova-compute[74959]: DEBUG nova.compute.manager [req-3a8d519c-220c-4379-a35e-b856780bb42e req-e00910c4-0b16-4b67-9cdc-971ecb149bdd service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] No waiting events found dispatching network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:39:38 user nova-compute[74959]: WARNING nova.compute.manager [req-3a8d519c-220c-4379-a35e-b856780bb42e req-e00910c4-0b16-4b67-9cdc-971ecb149bdd service nova] [instance: fd356d7f-cabd-4432-a69c-63f56aa6f6d8] Received unexpected event network-vif-plugged-4870b782-3a5c-4a53-b8e3-a80377cd8044 for instance with vm_state active and task_state deleting.
Nov 28 23:39:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:39:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:39:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:39:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:39:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:39:38 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Deleted allocations for instance fd356d7f-cabd-4432-a69c-63f56aa6f6d8
Nov 28 23:39:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-4def55f5-b193-4adc-866d-4fb2fa7a6879 tempest-TestVolumeBootPattern-1296185511 tempest-TestVolumeBootPattern-1296185511-project-member] Lock "fd356d7f-cabd-4432-a69c-63f56aa6f6d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.701s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:39:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:39:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:39:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:40:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:40:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:40:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:40:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:40:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:40:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:40:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:40:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:40:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:40:23 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:40:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:40:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9148MB free_disk=25.106918334960938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:40:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:40:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:40:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:40:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:40:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:40:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:40:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:40:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:40:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:40:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:41:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:41:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:41:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:41:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:41:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:41:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:41:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:41:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:41:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:41:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:41:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:41:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:41:25 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:41:25 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:41:25 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:41:25 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9145MB free_disk=25.10489273071289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:41:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:41:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:41:26 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:41:26 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:41:26 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:41:26 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:41:26 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:41:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:41:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:41:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:41:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:41:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:41:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:41:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:41:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:41:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:42:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:42:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:42:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:42:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Starting instance... {{(pid=74959) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74959) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 23:42:20 user nova-compute[74959]: INFO nova.compute.claims [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Claim successful on node user
Nov 28 23:42:20 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Start building networks asynchronously for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Allocating IP information in the background. {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG nova.network.neutron [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] allocate_for_instance() {{(pid=74959) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 23:42:21 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 23:42:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Start building block device mappings for instance. {{(pid=74959) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG nova.policy [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '148fc2875e3d4ed0b494cf89fb0fcb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4132da2d9a4939a952aade645f28f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74959) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Start spawning the instance on the hypervisor. {{(pid=74959) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Creating instance directory {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 23:42:21 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Creating image(s)
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "/opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "/opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "/opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.220s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk 1073741824 {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8,backing_fmt=raw /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk 1073741824" returned: 0 in 0.051s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "61bcca3c9d5b447059bb73dbf5df042035919cd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk. size=1073741824 {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:42:21 user nova-compute[74959]: DEBUG nova.network.neutron [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Successfully created port: 82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG nova.virt.disk.api [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Cannot resize image /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk to a smaller size. {{(pid=74959) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Created local disks {{(pid=74959) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Ensure instance console log exists: /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/console.log {{(pid=74959) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Successfully updated port: 82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Building network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG nova.network.neutron [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Instance cache missing network info. {{(pid=74959) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-86938471-7d3b-4c79-9865-f5bebdb5d100 req-a28f793e-9c35-45e0-80a6-7d9e8a033ad0 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received event network-changed-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG nova.compute.manager [req-86938471-7d3b-4c79-9865-f5bebdb5d100 req-a28f793e-9c35-45e0-80a6-7d9e8a033ad0 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Refreshing instance network info cache due to event network-changed-82b0df9f-804a-4279-b35e-b492c29235b5. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:42:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-86938471-7d3b-4c79-9865-f5bebdb5d100 req-a28f793e-9c35-45e0-80a6-7d9e8a033ad0 service nova] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.network.neutron [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Instance network_info: |[{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74959) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-86938471-7d3b-4c79-9865-f5bebdb5d100 req-a28f793e-9c35-45e0-80a6-7d9e8a033ad0 service nova] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-86938471-7d3b-4c79-9865-f5bebdb5d100 req-a28f793e-9c35-45e0-80a6-7d9e8a033ad0 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Refreshing network info cache for port 82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Start _get_guest_xml network_info=[{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_type': 'disk', 'image_id': 'dd44e43d-57fb-483e-b625-10657e7fc425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 23:42:23 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:42:23 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] CPU controller missing on host. {{(pid=74959) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.host [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] CPU controller found on host. {{(pid=74959) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74959) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T22:54:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T22:54:59Z,direct_url=<?>,disk_format='qcow2',id=dd44e43d-57fb-483e-b625-10657e7fc425,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='053eec02cccb48318ff5b24f5d53167c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T22:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Flavor limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Image limits 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Flavor pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Image pref 0:0:0 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74959) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Got 1 possible topologies {{(pid=74959) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.hardware [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74959) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2073535376',display_name='tempest-SnapshotDataIntegrityTests-server-2073535376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2073535376',id=53,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFPSRbi9174SZtU3wcxkVunQxY2Q8BfHtEQD19Qv9uQ/L72J3OpdJErwLb/wPL2UnO0OsIiNzKfW77dcLVgaU3iJHGmpV7De1bM7zZ0H4Q4xTjKmc3nX4RpD7aiGhPcoQ==',key_name='tempest-keypair-1262488136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f4132da2d9a4939a952aade645f28f6',ramdisk_id='',reservation_id='r-5f0ug3wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-357140793',owner_user_name='tempest-SnapshotDataIntegrityTests-357140793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:42:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='148fc2875e3d4ed0b494cf89fb0fcb78',uuid=656eaea0-1d33-4736-9d4f-7e8f1a824f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74959) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Converting VIF {"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:95,bridge_name='br-int',has_traffic_filtering=True,id=82b0df9f-804a-4279-b35e-b492c29235b5,network=Network(9d1d9305-e379-4d7a-b1bb-b5b73147161d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82b0df9f-80') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.objects.instance [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'pci_devices' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] End _get_guest_xml xml=<domain type="kvm">
Nov 28 23:42:23 user nova-compute[74959]:   <uuid>656eaea0-1d33-4736-9d4f-7e8f1a824f85</uuid>
Nov 28 23:42:23 user nova-compute[74959]:   <name>instance-00000035</name>
Nov 28 23:42:23 user nova-compute[74959]:   <memory>524288</memory>
Nov 28 23:42:23 user nova-compute[74959]:   <vcpu>1</vcpu>
Nov 28 23:42:23 user nova-compute[74959]:   <metadata>
Nov 28 23:42:23 user nova-compute[74959]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 23:42:23 user nova-compute[74959]:       <nova:package version="0.0.0"/>
Nov 28 23:42:23 user nova-compute[74959]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2073535376</nova:name>
Nov 28 23:42:23 user nova-compute[74959]:       <nova:creationTime>2023-11-28 23:42:23</nova:creationTime>
Nov 28 23:42:23 user nova-compute[74959]:       <nova:flavor name="m1.tiny">
Nov 28 23:42:23 user nova-compute[74959]:         <nova:memory>512</nova:memory>
Nov 28 23:42:23 user nova-compute[74959]:         <nova:disk>1</nova:disk>
Nov 28 23:42:23 user nova-compute[74959]:         <nova:swap>0</nova:swap>
Nov 28 23:42:23 user nova-compute[74959]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 23:42:23 user nova-compute[74959]:         <nova:vcpus>1</nova:vcpus>
Nov 28 23:42:23 user nova-compute[74959]:       </nova:flavor>
Nov 28 23:42:23 user nova-compute[74959]:       <nova:owner>
Nov 28 23:42:23 user nova-compute[74959]:         <nova:user uuid="148fc2875e3d4ed0b494cf89fb0fcb78">tempest-SnapshotDataIntegrityTests-357140793-project-member</nova:user>
Nov 28 23:42:23 user nova-compute[74959]:         <nova:project uuid="1f4132da2d9a4939a952aade645f28f6">tempest-SnapshotDataIntegrityTests-357140793</nova:project>
Nov 28 23:42:23 user nova-compute[74959]:       </nova:owner>
Nov 28 23:42:23 user nova-compute[74959]:       <nova:root type="image" uuid="dd44e43d-57fb-483e-b625-10657e7fc425"/>
Nov 28 23:42:23 user nova-compute[74959]:       <nova:ports>
Nov 28 23:42:23 user nova-compute[74959]:         <nova:port uuid="82b0df9f-804a-4279-b35e-b492c29235b5">
Nov 28 23:42:23 user nova-compute[74959]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 23:42:23 user nova-compute[74959]:         </nova:port>
Nov 28 23:42:23 user nova-compute[74959]:       </nova:ports>
Nov 28 23:42:23 user nova-compute[74959]:     </nova:instance>
Nov 28 23:42:23 user nova-compute[74959]:   </metadata>
Nov 28 23:42:23 user nova-compute[74959]:   <sysinfo type="smbios">
Nov 28 23:42:23 user nova-compute[74959]:     <system>
Nov 28 23:42:23 user nova-compute[74959]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 23:42:23 user nova-compute[74959]:       <entry name="product">OpenStack Nova</entry>
Nov 28 23:42:23 user nova-compute[74959]:       <entry name="version">0.0.0</entry>
Nov 28 23:42:23 user nova-compute[74959]:       <entry name="serial">656eaea0-1d33-4736-9d4f-7e8f1a824f85</entry>
Nov 28 23:42:23 user nova-compute[74959]:       <entry name="uuid">656eaea0-1d33-4736-9d4f-7e8f1a824f85</entry>
Nov 28 23:42:23 user nova-compute[74959]:       <entry name="family">Virtual Machine</entry>
Nov 28 23:42:23 user nova-compute[74959]:     </system>
Nov 28 23:42:23 user nova-compute[74959]:   </sysinfo>
Nov 28 23:42:23 user nova-compute[74959]:   <os>
Nov 28 23:42:23 user nova-compute[74959]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 23:42:23 user nova-compute[74959]:     <boot dev="hd"/>
Nov 28 23:42:23 user nova-compute[74959]:     <smbios mode="sysinfo"/>
Nov 28 23:42:23 user nova-compute[74959]:   </os>
Nov 28 23:42:23 user nova-compute[74959]:   <features>
Nov 28 23:42:23 user nova-compute[74959]:     <acpi/>
Nov 28 23:42:23 user nova-compute[74959]:     <apic/>
Nov 28 23:42:23 user nova-compute[74959]:     <vmcoreinfo/>
Nov 28 23:42:23 user nova-compute[74959]:   </features>
Nov 28 23:42:23 user nova-compute[74959]:   <clock offset="utc">
Nov 28 23:42:23 user nova-compute[74959]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 23:42:23 user nova-compute[74959]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 23:42:23 user nova-compute[74959]:     <timer name="hpet" present="no"/>
Nov 28 23:42:23 user nova-compute[74959]:   </clock>
Nov 28 23:42:23 user nova-compute[74959]:   <cpu mode="custom" match="exact">
Nov 28 23:42:23 user nova-compute[74959]:     <model>Nehalem</model>
Nov 28 23:42:23 user nova-compute[74959]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 23:42:23 user nova-compute[74959]:   </cpu>
Nov 28 23:42:23 user nova-compute[74959]:   <devices>
Nov 28 23:42:23 user nova-compute[74959]:     <disk type="file" device="disk">
Nov 28 23:42:23 user nova-compute[74959]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 23:42:23 user nova-compute[74959]:       <source file="/opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk"/>
Nov 28 23:42:23 user nova-compute[74959]:       <target dev="vda" bus="virtio"/>
Nov 28 23:42:23 user nova-compute[74959]:     </disk>
Nov 28 23:42:23 user nova-compute[74959]:     <interface type="ethernet">
Nov 28 23:42:23 user nova-compute[74959]:       <mac address="fa:16:3e:f4:27:95"/>
Nov 28 23:42:23 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:42:23 user nova-compute[74959]:       <mtu size="1442"/>
Nov 28 23:42:23 user nova-compute[74959]:       <target dev="tap82b0df9f-80"/>
Nov 28 23:42:23 user nova-compute[74959]:     </interface>
Nov 28 23:42:23 user nova-compute[74959]:     <serial type="pty">
Nov 28 23:42:23 user nova-compute[74959]:       <log file="/opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/console.log" append="off"/>
Nov 28 23:42:23 user nova-compute[74959]:     </serial>
Nov 28 23:42:23 user nova-compute[74959]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 23:42:23 user nova-compute[74959]:     <video>
Nov 28 23:42:23 user nova-compute[74959]:       <model type="virtio"/>
Nov 28 23:42:23 user nova-compute[74959]:     </video>
Nov 28 23:42:23 user nova-compute[74959]:     <rng model="virtio">
Nov 28 23:42:23 user nova-compute[74959]:       <backend model="random">/dev/urandom</backend>
Nov 28 23:42:23 user nova-compute[74959]:     </rng>
Nov 28 23:42:23 user nova-compute[74959]:     <controller type="usb" index="0" model="none"/>
Nov 28 23:42:23 user nova-compute[74959]:     <memballoon model="virtio">
Nov 28 23:42:23 user nova-compute[74959]:       <stats period="10"/>
Nov 28 23:42:23 user nova-compute[74959]:     </memballoon>
Nov 28 23:42:23 user nova-compute[74959]:   </devices>
Nov 28 23:42:23 user nova-compute[74959]: </domain>
Nov 28 23:42:23 user nova-compute[74959]:  {{(pid=74959) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2073535376',display_name='tempest-SnapshotDataIntegrityTests-server-2073535376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2073535376',id=53,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFPSRbi9174SZtU3wcxkVunQxY2Q8BfHtEQD19Qv9uQ/L72J3OpdJErwLb/wPL2UnO0OsIiNzKfW77dcLVgaU3iJHGmpV7De1bM7zZ0H4Q4xTjKmc3nX4RpD7aiGhPcoQ==',key_name='tempest-keypair-1262488136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f4132da2d9a4939a952aade645f28f6',ramdisk_id='',reservation_id='r-5f0ug3wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-357140793',owner_user_name='tempest-SnapshotDataIntegrityTests-357140793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T23:42:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='148fc2875e3d4ed0b494cf89fb0fcb78',uuid=656eaea0-1d33-4736-9d4f-7e8f1a824f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Converting VIF {"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:95,bridge_name='br-int',has_traffic_filtering=True,id=82b0df9f-804a-4279-b35e-b492c29235b5,network=Network(9d1d9305-e379-4d7a-b1bb-b5b73147161d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82b0df9f-80') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG os_vif [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:95,bridge_name='br-int',has_traffic_filtering=True,id=82b0df9f-804a-4279-b35e-b492c29235b5,network=Network(9d1d9305-e379-4d7a-b1bb-b5b73147161d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82b0df9f-80') {{(pid=74959) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dc204e3-4d42-5ac2-9ad7-b6bae2ff94fd', '_type': 'linux-noop'}}, row=False) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82b0df9f-80, may_exist=True, interface_attrs={}) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82b0df9f-80, col_values=(('qos', UUID('a854e618-3e8c-41ef-820f-b85dce61d27c')),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82b0df9f-80, col_values=(('external_ids', {'iface-id': '82b0df9f-804a-4279-b35e-b492c29235b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:27:95', 'vm-uuid': '656eaea0-1d33-4736-9d4f-7e8f1a824f85'}),), if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:23 user nova-compute[74959]: INFO os_vif [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:27:95,bridge_name='br-int',has_traffic_filtering=True,id=82b0df9f-804a-4279-b35e-b492c29235b5,network=Network(9d1d9305-e379-4d7a-b1bb-b5b73147161d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82b0df9f-80')
Nov 28 23:42:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No VIF found with MAC fa:16:3e:f4:27:95, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-86938471-7d3b-4c79-9865-f5bebdb5d100 req-a28f793e-9c35-45e0-80a6-7d9e8a033ad0 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updated VIF entry in instance network info cache for port 82b0df9f-804a-4279-b35e-b492c29235b5. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG nova.network.neutron [req-86938471-7d3b-4c79-9865-f5bebdb5d100 req-a28f793e-9c35-45e0-80a6-7d9e8a033ad0 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:42:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-86938471-7d3b-4c79-9865-f5bebdb5d100 req-a28f793e-9c35-45e0-80a6-7d9e8a033ad0 service nova] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:42:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-2e33e014-cbda-4108-9b88-ac7677de6b87 req-13f4e7b1-2ecb-4804-9c50-2c2bb3f189a5 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received event network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:42:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e33e014-cbda-4108-9b88-ac7677de6b87 req-13f4e7b1-2ecb-4804-9c50-2c2bb3f189a5 service nova] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e33e014-cbda-4108-9b88-ac7677de6b87 req-13f4e7b1-2ecb-4804-9c50-2c2bb3f189a5 service nova] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-2e33e014-cbda-4108-9b88-ac7677de6b87 req-13f4e7b1-2ecb-4804-9c50-2c2bb3f189a5 service nova] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:25 user nova-compute[74959]: DEBUG nova.compute.manager [req-2e33e014-cbda-4108-9b88-ac7677de6b87 req-13f4e7b1-2ecb-4804-9c50-2c2bb3f189a5 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] No waiting events found dispatching network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:42:25 user nova-compute[74959]: WARNING nova.compute.manager [req-2e33e014-cbda-4108-9b88-ac7677de6b87 req-13f4e7b1-2ecb-4804-9c50-2c2bb3f189a5 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received unexpected event network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 for instance with vm_state building and task_state spawning.
Nov 28 23:42:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:25 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:42:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:26 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:42:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:42:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:42:26 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Instance event wait completed in 0 seconds for  {{(pid=74959) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Guest created on hypervisor {{(pid=74959) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-80a309cf-294b-437a-9fe1-25a6205d267d req-09043639-8af8-4100-9a32-42fbb4541fc3 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received event network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80a309cf-294b-437a-9fe1-25a6205d267d req-09043639-8af8-4100-9a32-42fbb4541fc3 service nova] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80a309cf-294b-437a-9fe1-25a6205d267d req-09043639-8af8-4100-9a32-42fbb4541fc3 service nova] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-80a309cf-294b-437a-9fe1-25a6205d267d req-09043639-8af8-4100-9a32-42fbb4541fc3 service nova] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.manager [req-80a309cf-294b-437a-9fe1-25a6205d267d req-09043639-8af8-4100-9a32-42fbb4541fc3 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] No waiting events found dispatching network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:42:27 user nova-compute[74959]: WARNING nova.compute.manager [req-80a309cf-294b-437a-9fe1-25a6205d267d req-09043639-8af8-4100-9a32-42fbb4541fc3 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received unexpected event network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 for instance with vm_state building and task_state spawning.
Nov 28 23:42:27 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Instance spawned successfully.
Nov 28 23:42:27 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:42:27 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.090160369873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Found default for hw_cdrom_bus of ide {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Found default for hw_disk_bus of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Found default for hw_input_bus of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Found default for hw_pointer_model of None {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Found default for hw_video_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Found default for hw_vif_model of virtio {{(pid=74959) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:42:27 user nova-compute[74959]: INFO nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Checking state {{(pid=74959) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:42:27 user nova-compute[74959]: INFO nova.compute.manager [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Took 7.17 seconds to build instance.
Nov 28 23:42:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-685759df-0c43-4b0a-92fd-caf15e6123c7 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.293s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:42:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:42:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:43:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:43:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:43:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:43:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:43:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:43:10 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:43:11 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:43:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:43:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:43:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:43:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:43:27 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:43:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:43:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:43:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=25.059051513671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:43:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:43:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:43:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:43:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:43:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:43:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:43:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:43:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:43:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:43:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:43:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:43:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:43:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:43:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:44:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-fca73b14-f9e0-4b3e-8489-319199ed590c req-68b5335d-a8b7-4561-94be-7cebdbdcd459 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received event network-changed-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG nova.compute.manager [req-fca73b14-f9e0-4b3e-8489-319199ed590c req-68b5335d-a8b7-4561-94be-7cebdbdcd459 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Refreshing instance network info cache due to event network-changed-82b0df9f-804a-4279-b35e-b492c29235b5. {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 23:44:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fca73b14-f9e0-4b3e-8489-319199ed590c req-68b5335d-a8b7-4561-94be-7cebdbdcd459 service nova] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fca73b14-f9e0-4b3e-8489-319199ed590c req-68b5335d-a8b7-4561-94be-7cebdbdcd459 service nova] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-fca73b14-f9e0-4b3e-8489-319199ed590c req-68b5335d-a8b7-4561-94be-7cebdbdcd459 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Refreshing network info cache for port 82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-fca73b14-f9e0-4b3e-8489-319199ed590c req-68b5335d-a8b7-4561-94be-7cebdbdcd459 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updated VIF entry in instance network info cache for port 82b0df9f-804a-4279-b35e-b492c29235b5. {{(pid=74959) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG nova.network.neutron [req-fca73b14-f9e0-4b3e-8489-319199ed590c req-68b5335d-a8b7-4561-94be-7cebdbdcd459 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-fca73b14-f9e0-4b3e-8489-319199ed590c req-68b5335d-a8b7-4561-94be-7cebdbdcd459 service nova] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:44:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:44:15 user nova-compute[74959]: INFO nova.compute.manager [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attaching volume 4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 to /dev/vdb
Nov 28 23:44:15 user nova-compute[74959]: DEBUG os_brick.utils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[813c69c3-4755-4439-a06f-003ff6d9eb41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9362da30-85fb-44c1-91e2-d78852b4def3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925a858-fb85-4d0c-9805-876850d3c9ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d756bfc5-43bb-4315-99a0-460aa90791e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:44:15 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:44:15 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa8eaf3-8d33-47ff-b61b-286007129da4]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG os_brick.utils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:44:15 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating existing volume attachment record: ff586bf9-c0f8-4edd-9280-6aa0afb29809 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:44:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:44:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqgltzLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:44:22 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:44:22 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:44:22 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b969992-2199-412c-b8e1-58454265f012]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:44:22 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0937ae8-ac7a-4b88-a908-8900aa3fb068]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2] added
Nov 28 23:44:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[287764b2-63bb-424f-a52f-8f7dcd0756c3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f98900-48b4-40ea-88b9-3a7f456cf2d6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqgltzLC {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SqgltzLC" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b7cff3-3ea4-407d-89b1-b52f2b1bee1c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SqgltzLC'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a5b35-d38b-4903-8c4e-bd2debe1405c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fd0f1d-a39d-4ff5-85e7-ede83775b754]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:44:22 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:44:22 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:44:22 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:44:22 user nova-compute[74959]: 
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1fbea-8b7a-4652-ba52-29a3e53e296a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2, portal: 172.16.0.220,3260]
Nov 28 23:44:22 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2, portal: 172.16.0.220,3260] successful.
Nov 28 23:44:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[05828278-d4c3-43f7-9c4c-9165b8e8ddab]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[630fea27-8de7-4260-ac2e-2127a7660e9c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 (non-flash)
Nov 28 23:44:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 (non-flash)
Nov 28 23:44:22 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f323fd-d4e6-474a-bc71-1c53bc0f3e66]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqgltzLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:44:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23036383263333465', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036383263333465', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:44:23 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:44:23 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:44:23 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:44:23 user nova-compute[74959]:   <serial>4ee6a86c-6533-4796-a0e1-5635bbe3c5f2</serial>
Nov 28 23:44:23 user nova-compute[74959]: </disk>
Nov 28 23:44:23 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:44:23 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No VIF found with MAC fa:16:3e:f4:27:95, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:44:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d5b63e1f-bab3-4f2a-ae29-b5686892f6e8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.901s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:44:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:44:28 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74959) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 23:44:29 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:44:29 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:44:29 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.05794906616211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:44:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:44:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:44:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:44:40 user nova-compute[74959]: INFO nova.compute.manager [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Detaching volume 4ee6a86c-6533-4796-a0e1-5635bbe3c5f2
Nov 28 23:44:40 user nova-compute[74959]: INFO nova.virt.block_device [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attempting to driver detach volume 4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 from mountpoint /dev/vdb
Nov 28 23:44:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Attempting to detach device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:44:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:44:40 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:44:40 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:44:40 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:44:40 user nova-compute[74959]:   <serial>4ee6a86c-6533-4796-a0e1-5635bbe3c5f2</serial>
Nov 28 23:44:40 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:44:40 user nova-compute[74959]: </disk>
Nov 28 23:44:40 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:44:40 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully detached device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the persistent domain config.
Nov 28 23:44:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:44:40 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:44:40 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:44:40 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:44:40 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:44:40 user nova-compute[74959]:   <serial>4ee6a86c-6533-4796-a0e1-5635bbe3c5f2</serial>
Nov 28 23:44:40 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:44:40 user nova-compute[74959]: </disk>
Nov 28 23:44:40 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:44:41 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:44:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:44:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:44:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 is timed out.
Nov 28 23:45:01 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully detached device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the live domain config.
Nov 28 23:45:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SqgltzLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:45:01 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec06f5c5-4757-4511-810f-c6eb2916f2eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:45:01 user nova-compute[74959]: No targets found.
Nov 28 23:45:01 user nova-compute[74959]: iSNS:
Nov 28 23:45:01 user nova-compute[74959]: No targets found.
Nov 28 23:45:01 user nova-compute[74959]: STATIC:
Nov 28 23:45:01 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2
Nov 28 23:45:01 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:45:01 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:45:01 user nova-compute[74959]: FIRMWARE:
Nov 28 23:45:01 user nova-compute[74959]: No targets found.
Nov 28 23:45:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:45:01 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:45:01 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9707dafb-6e6b-4c6a-a337-9c82864bf302]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c571e1b8-e738-4804-bf7c-d17818ec3327]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 (non-flash)
Nov 28 23:45:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 (non-flash)
Nov 28 23:45:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef478b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c34910-ee3b-4afc-944a-bb14c76d5f6c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa56e7c-5c0e-47d0-b598-3cce84a6d97a]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e9dd2a-afab-4621-89a9-b5fd797571a6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5a0831-a6f9-45ac-8917-075bf1d1b9ae]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcef9cb-cb55-4d18-b438-f41f3563b48b]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0f9656-f977-4603-81ef-158494789d55]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2, portal: 172.16.0.220,3260]
Nov 28 23:45:01 user nova-compute[74959]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2, portal: 172.16.0.220,3260] successful.
Nov 28 23:45:01 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ee6a86c-6533-4796-a0e1-5635bbe3c5f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b0ac8e-9d0d-4919-bde8-9d7146758056]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== disconnect_volume: return (295ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:45:01 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:45:02 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:45:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f3672ca2-973a-47be-8beb-965b9768b676 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.659s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:45:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:45:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:45:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:45:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:45:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:45:11 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:45:11 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:45:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:45:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:45:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:45:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:45:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:45:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:30 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:31 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:45:31 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.05712890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:45:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:45:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:45:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:45:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:45:33 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:45:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:45:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:45:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:45:33 user nova-compute[74959]: INFO nova.compute.manager [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attaching volume 3b1c2715-9353-48b1-a166-e14cfafe3df2 to /dev/vdb
Nov 28 23:45:33 user nova-compute[74959]: DEBUG os_brick.utils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:45:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[64622384-40a0-420d-96ed-8095fec0180a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c51023-2e3d-4cbf-a710-947236d67a66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1ca747-2b05-478f-b620-c49a0d3c7c6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6399b48-0c1a-475f-bc4d-26fe5f302ccb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:45:34 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:45:34 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[19730aa9-ba23-4b6e-9a19-5ae640fa2792]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG os_brick.utils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:45:34 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating existing volume attachment record: 6303cf9f-943b-4e61-a7c7-d46094003c04 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:45:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:45:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipUDgFTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:45:43 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:45:43 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:45:43 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d55470-1769-4961-9866-e646e07fc4b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:45:43 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca7b413-83ed-47ea-a7c0-606a33548525]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2] added
Nov 28 23:45:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79edde9-a019-4f7b-a5bc-b8eb8a9f73f3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8cf1a-b81a-4236-b519-bbe7bf2a0cf3]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipUDgFTQ {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipUDgFTQ" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf873c-d3f4-4ab7-a85c-058fb24d0089]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipUDgFTQ'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e739c8-89d3-4021-b8be-291a00943a6e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3328909a-7b88-48ab-9187-bb075bd9d87c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:45:43 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:45:43 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:45:43 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:45:43 user nova-compute[74959]: 
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2f2c5-20d2-419f-9d25-00018ed8d205]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2, portal: 172.16.0.220,3260]
Nov 28 23:45:43 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2, portal: 172.16.0.220,3260] successful.
Nov 28 23:45:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2365d33-4e44-4948-af4d-120e3d287e24]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc66d6d-8572-437d-9b0a-0dd76270a267]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 (non-flash)
Nov 28 23:45:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 (non-flash)
Nov 28 23:45:43 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9c14cd-6386-417e-bc7d-779daae8c405]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:45:43 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipUDgFTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23130313062313535', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130313062313535', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG nova.objects.instance [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:45:44 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:45:44 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:45:44 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:45:44 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:45:44 user nova-compute[74959]:   <serial>3b1c2715-9353-48b1-a166-e14cfafe3df2</serial>
Nov 28 23:45:44 user nova-compute[74959]: </disk>
Nov 28 23:45:44 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:45:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:45:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:45:45 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No VIF found with MAC fa:16:3e:f4:27:95, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:45:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-d4a4b017-e7df-48a0-84ab-6d3df3b263a2 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.512s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:45:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:45:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:45:47 user nova-compute[74959]: INFO nova.compute.manager [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Detaching volume 3b1c2715-9353-48b1-a166-e14cfafe3df2
Nov 28 23:45:47 user nova-compute[74959]: INFO nova.virt.block_device [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attempting to driver detach volume 3b1c2715-9353-48b1-a166-e14cfafe3df2 from mountpoint /dev/vdb
Nov 28 23:45:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Attempting to detach device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:45:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:45:47 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:45:47 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:45:47 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:45:47 user nova-compute[74959]:   <serial>3b1c2715-9353-48b1-a166-e14cfafe3df2</serial>
Nov 28 23:45:47 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:45:47 user nova-compute[74959]: </disk>
Nov 28 23:45:47 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:45:47 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully detached device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the persistent domain config.
Nov 28 23:45:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:45:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:45:47 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:45:47 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:45:47 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:45:47 user nova-compute[74959]:   <serial>3b1c2715-9353-48b1-a166-e14cfafe3df2</serial>
Nov 28 23:45:47 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:45:47 user nova-compute[74959]: </disk>
Nov 28 23:45:47 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:45:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:45:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:45:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:46:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 is timed out.
Nov 28 23:46:07 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully detached device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the live domain config.
Nov 28 23:46:07 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:46:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipUDgFTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:46:07 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:46:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:46:07 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:46:07 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2491c0e-4a92-4edd-aae6-9a6723df600a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:46:08 user nova-compute[74959]: No targets found.
Nov 28 23:46:08 user nova-compute[74959]: iSNS:
Nov 28 23:46:08 user nova-compute[74959]: No targets found.
Nov 28 23:46:08 user nova-compute[74959]: STATIC:
Nov 28 23:46:08 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2
Nov 28 23:46:08 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:46:08 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:46:08 user nova-compute[74959]: FIRMWARE:
Nov 28 23:46:08 user nova-compute[74959]: No targets found.
Nov 28 23:46:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:46:08 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:46:08 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[59669388-5b69-4322-930b-fc44c38ca8f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b11273-406b-4dea-b72b-0a8635243d75]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 (non-flash)
Nov 28 23:46:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 (non-flash)
Nov 28 23:46:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef464e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b02e28-f347-4869-88ac-782d885d303e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffff858-89c0-4b09-a63b-ae9427d7aea1]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3babf8-8ca9-4a7c-ad25-c2eb45160bd6]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[621f7a58-ae9a-4c79-b95d-88806ba35692]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb5f6de-3174-46b6-b988-b78f14c35f5e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0250d5d0-b857-47b7-b4bc-dac5392a9451]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2, portal: 172.16.0.220,3260]
Nov 28 23:46:08 user nova-compute[74959]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2, portal: 172.16.0.220,3260] successful.
Nov 28 23:46:08 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b1c2715-9353-48b1-a166-e14cfafe3df2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd5d428-0197-4465-af55-d5e2128ea52e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== disconnect_volume: return (273ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:46:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:09 user nova-compute[74959]: DEBUG nova.objects.instance [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:46:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-fc64c7b9-d758-463e-8634-9a90c538bc42 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:46:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:46:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:46:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:46:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:46:10 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:46:10 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:46:11 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:46:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:46:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:46:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:46:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:46:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:46:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:46:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:46:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:46:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:31 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:32 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:46:32 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:46:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.056175231933594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:46:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:46:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:46:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG nova.objects.instance [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:46:40 user nova-compute[74959]: INFO nova.compute.manager [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attaching volume bc680856-549c-4783-917d-c40acc77d004 to /dev/vdb
Nov 28 23:46:40 user nova-compute[74959]: DEBUG os_brick.utils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9debf67c-5b90-4d83-a860-e4cefcba2f32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b67450-f1b0-4621-9f79-ed5d503906fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c14b23-a4ee-4572-906c-a0efddbdfa26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c672a45-c154-4965-9f23-f9f15e1360a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:46:40 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:46:40 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53e1200-880a-42c8-8087-23500128d1f3]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG os_brick.utils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:46:40 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating existing volume attachment record: a91734d1-4f2d-4296-8360-3a303f27d860 {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:46:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quhtiSZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:46:47 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:46:47 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:46:47 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8344b8-7ad4-4486-9747-32955720443c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:46:47 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c2227-a302-4662-bf01-f9dbbfa788fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004] added
Nov 28 23:46:47 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[888ad17d-aa8a-4fd9-b0ff-99dfe3e05ff7]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a56c692-6925-463b-8edf-f72035252213]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v quhtiSZD {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v quhtiSZD" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cdf4c7-a9eb-4014-b86d-dc897935d1d2]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:47 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'quhtiSZD'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec68cedb-f9fc-4381-ba07-45590b10a005]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a4f02-4e70-4e96-a89d-df3ab8b528e5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:46:48 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:46:48 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:46:48 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:46:48 user nova-compute[74959]: 
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f4e3c9-ee79-4659-a990-feaef7fede34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004, portal: 172.16.0.220,3260]
Nov 28 23:46:48 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004, portal: 172.16.0.220,3260] successful.
Nov 28 23:46:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eff2b6-bc99-42d0-999b-f94d818a6972]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf45111-7a44-4ed9-a989-b57290215f3c]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 (non-flash)
Nov 28 23:46:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 (non-flash)
Nov 28 23:46:48 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cad5f8-c960-46ac-9f1f-4fda996db8b5]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quhtiSZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:46:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26630326139326364', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630326139326364', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG nova.objects.instance [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:46:49 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:46:49 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:46:49 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:46:49 user nova-compute[74959]:   <serial>bc680856-549c-4783-917d-c40acc77d004</serial>
Nov 28 23:46:49 user nova-compute[74959]: </disk>
Nov 28 23:46:49 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No VIF found with MAC fa:16:3e:f4:27:95, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:46:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-603137b4-f161-46d2-bc22-0accdf7eec19 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.974s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:46:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:46:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:46:52 user nova-compute[74959]: INFO nova.compute.manager [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Detaching volume bc680856-549c-4783-917d-c40acc77d004
Nov 28 23:46:52 user nova-compute[74959]: INFO nova.virt.block_device [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attempting to driver detach volume bc680856-549c-4783-917d-c40acc77d004 from mountpoint /dev/vdb
Nov 28 23:46:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Attempting to detach device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:46:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:46:52 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:46:52 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:46:52 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:46:52 user nova-compute[74959]:   <serial>bc680856-549c-4783-917d-c40acc77d004</serial>
Nov 28 23:46:52 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:46:52 user nova-compute[74959]: </disk>
Nov 28 23:46:52 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:46:52 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully detached device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the persistent domain config.
Nov 28 23:46:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:46:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:46:52 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:46:52 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:46:52 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:46:52 user nova-compute[74959]:   <serial>bc680856-549c-4783-917d-c40acc77d004</serial>
Nov 28 23:46:52 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:46:52 user nova-compute[74959]: </disk>
Nov 28 23:46:52 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:46:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:46:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:46:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:47:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Triggering sync for uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 23:47:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:47:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:47:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:47:12 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 is timed out.
Nov 28 23:47:12 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully detached device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the live domain config.
Nov 28 23:47:12 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'quhtiSZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:47:12 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ae1cbd-1a11-44c5-bb2f-2989fbce942d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:47:12 user nova-compute[74959]: No targets found.
Nov 28 23:47:12 user nova-compute[74959]: iSNS:
Nov 28 23:47:12 user nova-compute[74959]: No targets found.
Nov 28 23:47:12 user nova-compute[74959]: STATIC:
Nov 28 23:47:12 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004
Nov 28 23:47:12 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:47:12 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:47:12 user nova-compute[74959]: FIRMWARE:
Nov 28 23:47:12 user nova-compute[74959]: No targets found.
Nov 28 23:47:12 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:47:12 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:47:12 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc03a5-aa3a-46e2-b650-bd9becc88b97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff036a2a-a0e2-46ec-8bcb-78d3817db61a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 (non-flash)
Nov 28 23:47:12 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 (non-flash)
Nov 28 23:47:12 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec103400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc15897-cbfc-4b89-bf73-dcde86e420bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe883917-4f66-4707-9dc9-52ed43cc1e47]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:47:12 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b783b07d-57f7-46de-8c89-7f2c5cc388ea]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ff17f-4337-40ef-b52a-eb505dcff86f]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f47e4e-3208-4293-9cea-2bdf06f6eb77]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40c736a-0090-4bec-b1cf-211d2d6d9cc7]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004, portal: 172.16.0.220,3260]
Nov 28 23:47:13 user nova-compute[74959]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004, portal: 172.16.0.220,3260] successful.
Nov 28 23:47:13 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc680856-549c-4783-917d-c40acc77d004 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a5bd5-ff14-40b3-8835-5e7843e7e15c]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== disconnect_volume: return (286ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG nova.objects.instance [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-388f82af-8226-4322-be56-3b8273f5982e tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.632s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.597s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:47:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:47:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:47:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:47:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:47:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:47:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=25.055191040039062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:47:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:47:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:47:45 user nova-compute[74959]: INFO nova.compute.manager [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attaching volume cfb7ca30-b6c9-4930-882a-82da87e2754a to /dev/vdb
Nov 28 23:47:45 user nova-compute[74959]: DEBUG os_brick.utils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ccd9e6-8c66-4a21-9b1d-2e0f03bbde6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e9e940ebfd25\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc871df0-8283-44e0-a368-c1a7c88539c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb49509-83c0-4b1c-b092-6bcc4612cdba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01eb1d5-bb5d-4608-991a-f2dc1bd36d4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:45 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Running cmd (subprocess): nvme version {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] 'nvme version' failed. Not Retrying. {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] nvme not present on system {{(pid=74959) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 23:47:46 user nova-compute[74959]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 23:47:46 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[847087f6-c40f-4f77-9bb3-3b45e80480e5]: (4, '') {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74959) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.lightos [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] LIGHTOS: no hostnqn found. {{(pid=74959) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG os_brick.utils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e9e940ebfd25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:47:46 user nova-compute[74959]: DEBUG nova.virt.block_device [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating existing volume attachment record: ad567842-c47e-4540-a079-5dbe2d9b4e9f {{(pid=74959) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 23:47:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Calling os-brick to attach iSCSI Volume {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qePVadlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:47:52 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:47:52 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:47:52 user nova-compute[74959]: INFO os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ef1d6-dad6-4b63-a318-e94671a4b504]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 23:47:52 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --interface default --op new {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde06f8b-56fd-47ff-9622-b9ca0c84e35f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a] added\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a] added
Nov 28 23:47:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff6c3bd-48da-4c95-86e2-f11a6fa3c74e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[637c9f1c-8ef2-4490-9338-0277e1db5669]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qePVadlB {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qePVadlB" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1bb381-7107-468f-9a6e-80b84615416e]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qePVadlB'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d1f03-9ae3-4195-8530-9a2ba9bb9065]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b197780e-e789-4e7c-9687-70e228e08f07]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:47:52 user nova-compute[74959]:  {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 23:47:52 user nova-compute[74959]:  {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:47:52 user nova-compute[74959]: WARNING os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 23:47:52 user nova-compute[74959]: 
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --login {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d0315d-781b-4caf-8525-01ac07fb5464]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a, portal: 172.16.0.220,3260]
Nov 28 23:47:52 user nova-compute[74959]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a, portal: 172.16.0.220,3260] successful.
Nov 28 23:47:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d871e-6113-47f6-8343-1ea763d910b8]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bd1167-4ded-4a22-b7a6-ee06ff54f95e]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a (non-flash)
Nov 28 23:47:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a (non-flash)
Nov 28 23:47:52 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Connected to 172.16.0.220:3260 {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74959) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74959) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b99d4-860e-42f4-99e9-5a1824dcd9b2]: (4, ('- - 0', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74959) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 23:47:52 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qePVadlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74959) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 23:47:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:47:53 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26430373734626166', 'path': '/dev/sdb'} {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:47:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430373734626166', 'path': '/dev/sdb'} {{(pid=74959) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 23:47:53 user nova-compute[74959]: DEBUG nova.objects.instance [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:47:53 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 23:47:53 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:47:53 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:47:53 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:47:53 user nova-compute[74959]:   <serial>cfb7ca30-b6c9-4930-882a-82da87e2754a</serial>
Nov 28 23:47:53 user nova-compute[74959]: </disk>
Nov 28 23:47:53 user nova-compute[74959]:  {{(pid=74959) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 23:47:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:47:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74959) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 23:47:54 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] No VIF found with MAC fa:16:3e:f4:27:95, not building metadata {{(pid=74959) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 23:47:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-f807553f-3aae-4461-b9bc-7ac6232fdae8 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.723s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:47:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:47:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:47:56 user nova-compute[74959]: INFO nova.compute.manager [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Detaching volume cfb7ca30-b6c9-4930-882a-82da87e2754a
Nov 28 23:47:57 user nova-compute[74959]: INFO nova.virt.block_device [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Attempting to driver detach volume cfb7ca30-b6c9-4930-882a-82da87e2754a from mountpoint /dev/vdb
Nov 28 23:47:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Attempting to detach device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the persistent domain config. {{(pid=74959) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 23:47:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:47:57 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:47:57 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:47:57 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:47:57 user nova-compute[74959]:   <serial>cfb7ca30-b6c9-4930-882a-82da87e2754a</serial>
Nov 28 23:47:57 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:47:57 user nova-compute[74959]: </disk>
Nov 28 23:47:57 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:47:57 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully detached device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the persistent domain config.
Nov 28 23:47:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the live domain config. {{(pid=74959) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 23:47:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.guest [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 23:47:57 user nova-compute[74959]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 23:47:57 user nova-compute[74959]:   <source dev="/dev/sdb"/>
Nov 28 23:47:57 user nova-compute[74959]:   <target dev="vdb" bus="virtio"/>
Nov 28 23:47:57 user nova-compute[74959]:   <serial>cfb7ca30-b6c9-4930-882a-82da87e2754a</serial>
Nov 28 23:47:57 user nova-compute[74959]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 23:47:57 user nova-compute[74959]: </disk>
Nov 28 23:47:57 user nova-compute[74959]:  {{(pid=74959) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 23:47:57 user nova-compute[74959]: DEBUG nova.virt.libvirt.driver [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 23:47:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:47:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:48:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:48:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:48:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 23:48:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquired lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 23:48:14 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Forcefully refreshing network info cache for instance {{(pid=74959) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 23:48:14 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lazy-loading 'info_cache' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:48:15 user nova-compute[74959]: DEBUG nova.network.neutron [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [{"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:48:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Releasing lock "refresh_cache-656eaea0-1d33-4736-9d4f-7e8f1a824f85" {{(pid=74959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 23:48:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updated the network info_cache for instance {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 23:48:17 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 is timed out.
Nov 28 23:48:17 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully detached device vdb from instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 from the live domain config.
Nov 28 23:48:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] calling os-brick to detach iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef45d8430>, {'target_iqn': 'iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qePVadlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 23:48:17 user nova-compute[74959]: WARNING os_brick.initiator.connectors.base [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[3824afec-e355-4343-adca-b35d6129e2ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 23:48:17 user nova-compute[74959]: No targets found.
Nov 28 23:48:17 user nova-compute[74959]: iSNS:
Nov 28 23:48:17 user nova-compute[74959]: No targets found.
Nov 28 23:48:17 user nova-compute[74959]: STATIC:
Nov 28 23:48:17 user nova-compute[74959]: Target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a
Nov 28 23:48:17 user nova-compute[74959]:         Portal: 172.16.0.220:3260,-1
Nov 28 23:48:17 user nova-compute[74959]:                 Iface Name: default
Nov 28 23:48:17 user nova-compute[74959]: FIRMWARE:
Nov 28 23:48:17 user nova-compute[74959]: No targets found.
Nov 28 23:48:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 23:48:17 user nova-compute[74959]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 23:48:17 user nova-compute[74959]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74959) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a', 0)] {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef7c4c8-5880-426a-bf48-11e104b614c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[33da4194-e7f3-402e-a0e7-18fb58ca324a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a (non-flash)\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a (non-flash)
Nov 28 23:48:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a (non-flash)
Nov 28 23:48:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5edc7c75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a'): ({'sdb'}, set())}) {{(pid=74959) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Removing single pathed devices sdb {{(pid=74959) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a93eb6-e659-4267-aff9-5d6f1c08eca0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[726897ff-acd0-4f2e-a9a9-a9c363102b3a]: (4, ('ok\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Flushing IO for device /dev/sdb {{(pid=74959) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec10eb-7f17-43ec-8471-19a47a006607]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74959) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e09098-d348-4a55-8af9-d4829d9160ef]: (4, ('1', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.linuxscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] SCSI volumes sdb have been removed. {{(pid=74959) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a')] {{(pid=74959) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e577ca-db09-4f60-85b0-fc135b299ea9]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --logout {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dcc739-5621-47b5-8072-e071bf65bfc6]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a, portal: 172.16.0.220,3260]
Nov 28 23:48:17 user nova-compute[74959]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a, portal: 172.16.0.220,3260] successful.
Nov 28 23:48:17 user nova-compute[74959]:  stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op delete {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfb7ca30-b6c9-4930-882a-82da87e2754a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a363647-d575-4e3b-ad88-aaf757718947]: (4, ('', '')) {{(pid=86637) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74959) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.base [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG os_brick.initiator.connectors.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] <== disconnect_volume: return (281ms) None {{(pid=74959) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 23:48:17 user nova-compute[74959]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Disconnected iSCSI Volume {{(pid=74959) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 23:48:18 user nova-compute[74959]: DEBUG nova.objects.instance [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'flavor' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:48:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-3168bdd4-12f8-46e6-aaf8-dcf84f6edfb4 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.603s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:48:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:48:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:48:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:33 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG oslo_concurrency.processutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 23:48:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:48:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:48:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.054222106933594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74959) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:48:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:48:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:48:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:48:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:49:10 user nova-compute[74959]: INFO nova.compute.manager [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Terminating instance
Nov 28 23:49:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Start destroying the instance on the hypervisor. {{(pid=74959) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-03fcd535-a027-4290-bd55-315da13b45f9 req-6d7410f4-eb3d-473a-9e63-3c7b16820614 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received event network-vif-unplugged-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03fcd535-a027-4290-bd55-315da13b45f9 req-6d7410f4-eb3d-473a-9e63-3c7b16820614 service nova] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03fcd535-a027-4290-bd55-315da13b45f9 req-6d7410f4-eb3d-473a-9e63-3c7b16820614 service nova] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-03fcd535-a027-4290-bd55-315da13b45f9 req-6d7410f4-eb3d-473a-9e63-3c7b16820614 service nova] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-03fcd535-a027-4290-bd55-315da13b45f9 req-6d7410f4-eb3d-473a-9e63-3c7b16820614 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] No waiting events found dispatching network-vif-unplugged-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:49:10 user nova-compute[74959]: DEBUG nova.compute.manager [req-03fcd535-a027-4290-bd55-315da13b45f9 req-6d7410f4-eb3d-473a-9e63-3c7b16820614 service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received event network-vif-unplugged-82b0df9f-804a-4279-b35e-b492c29235b5 for instance with task_state deleting. {{(pid=74959) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [-] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Instance destroyed successfully.
Nov 28 23:49:11 user nova-compute[74959]: DEBUG nova.objects.instance [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lazy-loading 'resources' on Instance uuid 656eaea0-1d33-4736-9d4f-7e8f1a824f85 {{(pid=74959) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG nova.virt.libvirt.vif [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T23:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2073535376',display_name='tempest-SnapshotDataIntegrityTests-server-2073535376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2073535376',id=53,image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFPSRbi9174SZtU3wcxkVunQxY2Q8BfHtEQD19Qv9uQ/L72J3OpdJErwLb/wPL2UnO0OsIiNzKfW77dcLVgaU3iJHGmpV7De1bM7zZ0H4Q4xTjKmc3nX4RpD7aiGhPcoQ==',key_name='tempest-keypair-1262488136',keypairs=<?>,launch_index=0,launched_at=2023-11-28T23:42:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f4132da2d9a4939a952aade645f28f6',ramdisk_id='',reservation_id='r-5f0ug3wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dd44e43d-57fb-483e-b625-10657e7fc425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-357140793',owner_user_name='tempest-SnapshotDataIntegrityTests-357140793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T23:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='148fc2875e3d4ed0b494cf89fb0fcb78',uuid=656eaea0-1d33-4736-9d4f-7e8f1a824f85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Converting VIF {"id": "82b0df9f-804a-4279-b35e-b492c29235b5", "address": "fa:16:3e:f4:27:95", "network": {"id": "9d1d9305-e379-4d7a-b1bb-b5b73147161d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1833143624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f4132da2d9a4939a952aade645f28f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82b0df9f-80", "ovs_interfaceid": "82b0df9f-804a-4279-b35e-b492c29235b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG nova.network.os_vif_util [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:27:95,bridge_name='br-int',has_traffic_filtering=True,id=82b0df9f-804a-4279-b35e-b492c29235b5,network=Network(9d1d9305-e379-4d7a-b1bb-b5b73147161d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82b0df9f-80') {{(pid=74959) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG os_vif [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:27:95,bridge_name='br-int',has_traffic_filtering=True,id=82b0df9f-804a-4279-b35e-b492c29235b5,network=Network(9d1d9305-e379-4d7a-b1bb-b5b73147161d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82b0df9f-80') {{(pid=74959) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82b0df9f-80, bridge=br-int, if_exists=True) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a854e618-3e8c-41ef-820f-b85dce61d27c) {{(pid=74959) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:11 user nova-compute[74959]: INFO os_vif [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:27:95,bridge_name='br-int',has_traffic_filtering=True,id=82b0df9f-804a-4279-b35e-b492c29235b5,network=Network(9d1d9305-e379-4d7a-b1bb-b5b73147161d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82b0df9f-80')
Nov 28 23:49:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Deleting instance files /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85_del
Nov 28 23:49:11 user nova-compute[74959]: INFO nova.virt.libvirt.driver [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Deletion of /opt/stack/data/nova/instances/656eaea0-1d33-4736-9d4f-7e8f1a824f85_del complete
Nov 28 23:49:11 user nova-compute[74959]: INFO nova.compute.manager [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 23:49:11 user nova-compute[74959]: DEBUG oslo.service.loopingcall [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74959) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG nova.compute.manager [-] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Deallocating network for instance {{(pid=74959) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 23:49:11 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] deallocate_for_instance() {{(pid=74959) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 23:49:12 user nova-compute[74959]: DEBUG nova.network.neutron [-] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Updating instance_info_cache with network_info: [] {{(pid=74959) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 23:49:12 user nova-compute[74959]: INFO nova.compute.manager [-] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Took 0.98 seconds to deallocate network for instance.
Nov 28 23:49:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:49:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:49:12 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:49:12 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:49:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:49:12 user nova-compute[74959]: INFO nova.scheduler.client.report [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Deleted allocations for instance 656eaea0-1d33-4736-9d4f-7e8f1a824f85
Nov 28 23:49:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b2f101ae-3f05-468e-bacf-3b47eba23f30 tempest-SnapshotDataIntegrityTests-357140793 tempest-SnapshotDataIntegrityTests-357140793-project-member] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.173s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:49:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebfb7fe3-ce57-4e46-9888-733380ecdedf req-a88dad89-923c-48b3-a925-481b5c9ee9ca service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received event network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:49:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebfb7fe3-ce57-4e46-9888-733380ecdedf req-a88dad89-923c-48b3-a925-481b5c9ee9ca service nova] Acquiring lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:49:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebfb7fe3-ce57-4e46-9888-733380ecdedf req-a88dad89-923c-48b3-a925-481b5c9ee9ca service nova] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:49:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [req-ebfb7fe3-ce57-4e46-9888-733380ecdedf req-a88dad89-923c-48b3-a925-481b5c9ee9ca service nova] Lock "656eaea0-1d33-4736-9d4f-7e8f1a824f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:49:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebfb7fe3-ce57-4e46-9888-733380ecdedf req-a88dad89-923c-48b3-a925-481b5c9ee9ca service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] No waiting events found dispatching network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 23:49:13 user nova-compute[74959]: WARNING nova.compute.manager [req-ebfb7fe3-ce57-4e46-9888-733380ecdedf req-a88dad89-923c-48b3-a925-481b5c9ee9ca service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received unexpected event network-vif-plugged-82b0df9f-804a-4279-b35e-b492c29235b5 for instance with vm_state deleted and task_state None.
Nov 28 23:49:13 user nova-compute[74959]: DEBUG nova.compute.manager [req-ebfb7fe3-ce57-4e46-9888-733380ecdedf req-a88dad89-923c-48b3-a925-481b5c9ee9ca service nova] [instance: 656eaea0-1d33-4736-9d4f-7e8f1a824f85] Received event network-vif-deleted-82b0df9f-804a-4279-b35e-b492c29235b5 {{(pid=74959) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 23:49:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:49:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:49:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:49:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:49:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:49:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:49:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:49:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:49:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:49:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:49:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:49:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:49:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:49:33 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:49:33 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:49:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9154MB free_disk=25.081310272216797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:49:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:49:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:49:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:49:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:49:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:49:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:49:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:49:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:49:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:49:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:49:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:49:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:49:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:49:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:49:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:49:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:49:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:50:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:50:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:50:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:50:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:50:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:50:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:50:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:50:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:50:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:50:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:50:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:50:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:50:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:50:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:50:33 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:50:33 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:50:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9261MB free_disk=24.979686737060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:50:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:50:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:50:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:50:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:50:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:50:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:50:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:50:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:50:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:50:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:50:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:50:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:50:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:50:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:50:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:51:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:51:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:51:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:51:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:51:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:51:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:51:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:51:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:51:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:51:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:51:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:51:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:51:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:51:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:51:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:51:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:51:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9275MB free_disk=25.064891815185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:51:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:51:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:51:35 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:51:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:51:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:51:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:51:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:51:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:51:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:51:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:51:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:51:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:52:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:52:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:52:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:52:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:52:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:52:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:52:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:52:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:52:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:52:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:52:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:52:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:52:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:52:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:52:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:52:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:52:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:52:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:52:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:52:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:52:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:52:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:52:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:52:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9257MB free_disk=24.962108612060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:52:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:52:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:52:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:52:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:52:36 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:52:36 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:52:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:52:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:52:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:52:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:52:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:52:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:52:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:53:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:53:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:53:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:53:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:53:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:53:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:53:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:53:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:53:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:53:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:53:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:53:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9262MB free_disk=24.96245574951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:53:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:53:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:53:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:53:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:53:36 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:53:36 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:53:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:53:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:53:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:53:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:53:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:53:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:53:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:54:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:54:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:54:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:54:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:54:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:54:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:54:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:54:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:54:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:54:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:54:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:54:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:54:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:54:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:54:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:54:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:54:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:54:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:54:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9272MB free_disk=24.96194839477539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:54:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:54:36 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:54:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:54:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:54:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:54:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:54:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:54:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:54:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:55:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:55:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:55:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:55:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:55:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:55:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:55:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:55:22 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:55:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:55:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:55:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:55:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:55:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:55:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:55:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9270MB free_disk=24.961463928222656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:55:37 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 23:55:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 23:55:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 23:55:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 23:55:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 23:55:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:55:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:55:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:55:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:55:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:55:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:55:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 23:55:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:55:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:55:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 23:56:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 23:56:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:56:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:56:24 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:56:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:56:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:56:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:56:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:56:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:56:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:34 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:56:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:56:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:56:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:56:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:56:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:56:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:56:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:56:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9295MB free_disk=24.960968017578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:56:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:56:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:56:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:56:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:56:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:56:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:56:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:56:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:56:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:56:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:56:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:56:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:57:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:57:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:57:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:57:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:57:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:57:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:57:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:57:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:57:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:57:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:57:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:57:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:57:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:57:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:57:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:57:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:57:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9295MB free_disk=24.960479736328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:57:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:57:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:57:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:57:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:57:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:57:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:57:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:57:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:57:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:57:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:57:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:57:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:57:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:57:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:57:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:57:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5102 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:57:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:57:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:57:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:57:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:58:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:58:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:58:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:58:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:58:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:58:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:58:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:58:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:58:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:58:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:58:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:58:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:58:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:58:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:58:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:58:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:58:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:58:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:58:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:58:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:58:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9296MB free_disk=24.95999526977539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:58:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:58:40 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:58:40 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:58:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:58:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:58:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:58:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:58:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:58:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:59:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:59:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:59:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:59:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:59:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:59:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 23:59:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 23:59:26 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 23:59:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:59:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:59:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 23:59:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:59:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 23:59:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:59:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:59:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 23:59:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:59:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 23:59:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9293MB free_disk=24.959484100341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 23:59:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 23:59:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 23:59:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:59:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 23:59:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 23:59:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:00:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:00:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:00:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:00:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:00:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:00:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:00:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:00:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:00:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:00:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:00:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:00:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:00:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:00:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:00:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:00:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:00:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:00:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:00:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9292MB free_disk=24.95828628540039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:00:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:00:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:00:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:00:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:00:50 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:00:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:00:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:01:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:01:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:01:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:01:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:01:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:01:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:01:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:01:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:01:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:01:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:01:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:01:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:01:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:01:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:01:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:01:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9286MB free_disk=24.957782745361328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:01:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:01:41 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:01:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:01:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:01:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:01:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:01:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:01:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:01:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:02:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:02:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:02:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:02:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:02:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:02:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:02:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:02:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:02:40 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:02:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9289MB free_disk=24.957305908203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:02:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:02:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:02:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:02:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:02:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:02:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:02:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:02:56 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:03:01 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:03:06 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:03:11 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:03:16 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:03:21 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:03:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:26 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:03:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:03:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:03:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:03:31 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:03:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:36 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:03:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:03:41 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:03:41 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:03:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9292MB free_disk=24.956809997558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:03:41 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:03:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:03:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:03:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:03:46 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:03:51 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:03:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:04:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:04:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:04:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:04:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:04:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:04:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:04:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:04:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:04:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:04:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:04:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:04:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:04:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:04:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:04:42 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:04:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9291MB free_disk=24.95630645751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:04:42 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:04:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:04:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:04:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:04:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:05:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:05:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:05:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:05:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:05:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:05:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:05:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:05:43 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:05:43 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:05:43 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:05:43 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9312MB free_disk=24.955821990966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:05:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:05:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:05:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:05:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:05:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:05:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:05:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:05:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:05:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:05:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:06:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:06:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:06:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:06:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:06:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:06:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:06:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:06:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:06:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:06:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:06:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:06:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:06:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:06:43 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:06:43 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:06:43 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9312MB free_disk=24.955322265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:06:43 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:06:44 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:06:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:06:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:06:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:06:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:06:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:06:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:07:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:07:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:07:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:07:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:07:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:07:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:07:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:07:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:07:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:07:44 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:07:44 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:07:44 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9314MB free_disk=24.954837799072266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:07:44 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:07:45 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:07:45 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:07:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:07:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:07:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:07:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:07:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:07:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:07:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:07:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:07:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:07:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:08:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:08:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:08:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:08:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:08:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:08:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:08:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:08:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:08:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:08:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:08:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:08:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:08:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:08:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:08:45 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:08:45 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:08:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9316MB free_disk=24.954341888427734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:08:45 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:08:46 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:08:46 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:08:46 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:08:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:08:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:08:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:08:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:09:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:09:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:09:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:09:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:09:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:09:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:09:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:09:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:44 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:09:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:09:47 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:09:47 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:09:47 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:09:47 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9317MB free_disk=24.95379638671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:09:47 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:09:48 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:09:48 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:09:48 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:09:48 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:09:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:09:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:09:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:09:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:09:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:09:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:09:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:10:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:10:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:10:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:10:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:10:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:10:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:10:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:10:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:10:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:10:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:10:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:10:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:10:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:10:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:10:49 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:10:49 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:10:49 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9318MB free_disk=24.95711898803711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:10:49 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:10:50 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:10:50 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:10:50 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:10:50 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:10:50 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:10:50 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:10:50 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:10:50 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:10:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:10:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:10:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:08 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:11:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:11:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:11:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:11:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:11:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:11:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:11:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:11:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:11:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:11:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:11:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:11:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:11:51 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:11:51 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:11:51 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:11:51 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9328MB free_disk=24.956615447998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:11:51 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:11:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:11:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:11:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:12:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:12:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:12:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:12:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:12:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:12:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:12:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:12:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:12:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:12:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:12:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:12:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:12:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:12:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:47 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:12:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:12:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:12:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:12:52 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:12:52 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:12:52 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9319MB free_disk=24.956130981445312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:12:52 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:12:53 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:12:53 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:12:53 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:12:53 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:12:53 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:12:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:12:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:12:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:13:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:13:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:13:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:13:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:13:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:13:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:13:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:13:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:13:53 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:13:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:13:53 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:13:53 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9317MB free_disk=24.955638885498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:13:53 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:13:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:13:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:13:54 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:13:54 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:13:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:13:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:13:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:13:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:14:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:14:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:14:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:14:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:14:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:14:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:14:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:14:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:14:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:14:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:14:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:14:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:14:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:14:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:14:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:14:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:14:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:14:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:14:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:14:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:14:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:14:54 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:14:54 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:14:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9322MB free_disk=24.955154418945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:14:54 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:14:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:14:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:14:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:15:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:15:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:15:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:15:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:15:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:15:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:15:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:15:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:15:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:15:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:15:41 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:15:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:15:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:15:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:15:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:15:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:15:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:15:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9318MB free_disk=24.954654693603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:15:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:15:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:15:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:15:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:16:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:16:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:16:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:16:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:16:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:16:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:16:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:16:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify base images {{(pid=74959) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc
Nov 29 00:16:24 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Removable base files: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49 /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308 /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69 /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc
Nov 29 00:16:24 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 29 00:16:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verification complete {{(pid=74959) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify swap images {{(pid=74959) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 00:16:24 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify ephemeral images {{(pid=74959) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 00:16:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:16:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:16:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:16:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:16:47 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:16:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:16:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:16:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9317MB free_disk=24.954143524169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:16:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:16:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:16:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:16:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:16:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:16:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:16:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:17:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:43 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:17:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:17:43 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:17:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:17:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:17:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:17:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:17:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:17:55 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:17:55 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9319MB free_disk=24.953655242919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:17:55 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:17:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:17:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:17:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:17:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:17:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:17:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:17:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:17:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:17:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:18:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:18:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:18:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:18:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:18:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:18:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:18:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:18:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:18:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:18:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:18:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:18:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:18:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:18:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:18:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:18:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:18:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9314MB free_disk=24.953163146972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:18:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:18:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:18:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:18:57 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:18:57 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:18:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:18:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:18:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:19:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:19:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:19:45 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:19:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:19:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:19:56 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:19:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9305MB free_disk=24.95269012451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:19:56 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:19:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:19:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:19:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:19:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:19:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:19:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:19:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:20:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:20:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:45 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:20:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:20:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:20:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:20:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:20:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:20:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:20:57 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:20:57 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:20:57 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9307MB free_disk=24.952178955078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:20:57 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:20:58 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:20:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:20:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:21:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:21:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:21:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:21:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:21:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:21:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:21:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:21:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:21:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:21:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:21:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:21:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:21:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:21:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:21:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:21:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:21:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:21:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:21:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:21:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:21:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:21:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:21:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:21:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:21:59 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:21:59 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9309MB free_disk=24.95168685913086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:21:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:21:59 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:22:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:22:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:22:00 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:22:00 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:22:00 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:22:00 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:22:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:22:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:22:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:22:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:22:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:22:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:22:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:22:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:22:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:22:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:22:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:22:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:22:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:22:49 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:22:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:22:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:22:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:22:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:22:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:22:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:22:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:22:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:23:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:23:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:23:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:23:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:23:01 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:23:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:23:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:23:01 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9312MB free_disk=24.95119857788086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:23:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:23:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:23:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:23:02 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:23:02 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:23:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:23:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:23:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:23:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:23:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:23:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:23:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:23:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:23:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:23:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:23:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:23:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:23:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:23:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:23:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:23:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:23:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:23:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:23:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:23:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:23:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:23:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:23:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:23:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:23:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:23:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:23:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:23:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:24:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:24:01 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:24:01 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9316MB free_disk=24.950714111328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:24:01 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:24:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:03 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:24:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:24:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:24:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:24:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:24:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:24:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:24:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:24:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:24:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:24:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:24:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:24:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:24:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:25:03 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:25:03 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:25:03 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9321MB free_disk=24.950210571289062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:25:03 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:25:04 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:25:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:25:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:25:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:05 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:25:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:25:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:25:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:25:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:25:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:25:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:25:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:25:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:25:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:25:51 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:25:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:25:51 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:25:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:25:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:25:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:25:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:26:04 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:26:04 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:26:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9304MB free_disk=24.94970703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:26:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:26:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:26:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:26:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:26:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:26:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:26:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:26:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:26:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:26:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:26:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:26:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:26:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:26:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:26:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:26:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:26:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:26:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:26:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:26:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:26:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:26:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:27:04 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:27:04 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:27:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9312MB free_disk=24.949207305908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:27:04 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:27:05 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:27:05 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:27:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:27:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:27:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:27:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:27:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:27:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:27:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:27:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:27:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:27:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:28:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:28:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:28:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:28:05 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:28:05 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:28:05 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:28:05 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9314MB free_disk=24.94873046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:28:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:28:05 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:28:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:28:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:28:06 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:28:06 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:28:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:28:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:28:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:28:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:28:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:28:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:28:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:28:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:28:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:28:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:28:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:28:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:28:52 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:28:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:28:52 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:28:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:28:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:28:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:28:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:29:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:29:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:29:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:29:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:29:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:29:06 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:29:06 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9313MB free_disk=24.948238372802734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:29:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:29:06 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:29:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:29:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:29:07 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:29:07 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:29:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:29:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:29:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:29:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:29:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:29:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:29:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:29:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:29:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:29:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:29:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:29:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:29:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:29:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:29:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:29:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:29:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:29:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:30:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:30:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:30:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:30:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:30:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9316MB free_disk=24.94775390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:30:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:30:08 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:30:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:30:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:30:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:30:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:30:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:30:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:30:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:30:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:30:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:30:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:30:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:30:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:30:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:30:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:30:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:30:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:30:55 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:30:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:30:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:31:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:31:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:31:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:31:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:31:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:31:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9317MB free_disk=24.947254180908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:31:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:31:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:31:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:31:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:31:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:31:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:31:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:31:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:31:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:31:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:31:42 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:31:42 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:31:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:31:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:31:52 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:31:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:31:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:31:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:31:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:31:57 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:32:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:02 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:32:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:32:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:32:07 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:32:07 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9318MB free_disk=24.946762084960938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:32:07 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:32:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:32:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:32:08 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:32:08 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:32:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:32:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:32:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:32:12 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:32:17 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:32:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:22 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:32:27 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:32:32 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:32:37 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:32:42 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:32:47 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:32:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:32:56 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:32:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:32:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:32:56 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:32:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:33:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:33:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:33:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:33:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:33:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:33:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:33:08 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:33:08 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:33:08 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9318MB free_disk=24.946269989013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:33:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:33:08 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:33:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:33:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:33:09 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:33:09 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:33:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:33:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:33:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:33:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:33:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:33:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:33:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:33:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:33:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:33:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:33:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:33:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:33:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:33:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:33:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:33:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:33:58 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:34:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:34:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:34:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:34:09 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:34:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9321MB free_disk=24.94574737548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:34:09 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:34:10 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:34:10 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:34:10 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:34:10 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:34:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:34:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:34:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:34:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:34:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:34:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:34:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:34:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:34:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:34:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:34:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:34:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:34:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:34:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:34:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:35:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:35:11 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:35:11 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:35:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9316MB free_disk=24.945236206054688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:35:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:35:12 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:35:12 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:35:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:35:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:35:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:35:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:17 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:35:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:35:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:35:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:35:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:35:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:35:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:36:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:36:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:36:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:36:11 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:36:11 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:36:11 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9324MB free_disk=24.94475555419922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:36:11 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:36:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:36:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:36:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:46 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:46 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:36:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:36:48 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:36:48 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:36:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:36:58 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:59 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:36:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:36:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:36:59 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:37:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:37:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:37:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:37:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:37:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:37:12 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:37:12 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:37:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9318MB free_disk=24.944252014160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:37:12 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:37:13 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:37:13 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:37:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:37:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:37:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:37:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:37:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:37:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:37:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:38:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:38:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:38:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:38:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:38:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:38:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:38:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:38:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:38:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9314MB free_disk=24.94377899169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:38:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:38:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:38:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:38:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:38:14 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:38:14 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:38:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:38:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:38:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:38:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:38:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:38:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:38:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:39:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:39:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:39:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:39:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:39:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:39:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:39:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:39:13 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:39:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9309MB free_disk=24.943275451660156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:39:13 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:39:14 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:39:14 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:39:14 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:39:14 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:39:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:39:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:39:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:39:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:39:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:39:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:39:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:39:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:39:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:39:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:39:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:40:01 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:40:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:40:01 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:40:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:40:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:40:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:40:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:40:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9309MB free_disk=24.942779541015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:40:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:40:16 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:40:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:40:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:40:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:40:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:40:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:40:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:40:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:40:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:41:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:41:02 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:41:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:41:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:41:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:41:15 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:41:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9315MB free_disk=24.942283630371094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:41:15 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:41:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:41:16 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:41:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:41:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:41:16 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:41:16 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:41:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:41:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:41:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:41:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:21 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:41:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:41:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:41:54 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:41:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:41:54 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:41:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:00 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:00 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:42:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:42:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:42:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:42:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:42:05 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:42:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:42:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:42:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:42:16 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:42:16 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:42:16 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9311MB free_disk=24.941795349121094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:42:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:42:16 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:42:17 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:42:17 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:42:17 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:42:17 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:42:17 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:42:17 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:42:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:23 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:42:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:42:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:42:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:42:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:43:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:43:04 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:43:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:43:18 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:43:18 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:43:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9311MB free_disk=24.941303253173828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:43:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:43:19 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:43:19 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:43:19 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:43:19 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:43:19 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:43:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:43:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:43:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:43:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:43:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:44:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:44:06 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:44:06 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:44:18 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:44:18 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:44:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9322MB free_disk=24.940818786621094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:44:18 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:44:19 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:44:19 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:44:19 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:44:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:44:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:44:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:44:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:44:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:44:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:45:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:45:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:45:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:45:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:45:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:45:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:45:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9313MB free_disk=24.9403076171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:45:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:45:21 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:45:21 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:45:21 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:45:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:45:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:45:25 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:45:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:45:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:46:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:46:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:46:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:46:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:08 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:46:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:46:20 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:46:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9317MB free_disk=24.93982696533203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:46:20 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:46:21 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:46:21 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:46:21 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:46:21 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:46:21 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:46:21 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:46:21 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:46:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:46:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:46:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:46:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:46:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:46:57 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:46:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:46:57 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:46:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:02 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:47:07 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:07 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:47:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:47:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:47:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:47:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:47:21 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:47:21 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:47:21 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9314MB free_disk=24.939327239990234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:47:21 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:47:22 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:47:22 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:47:22 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:47:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:47:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:47:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:47:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:47:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:47:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:48:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:48:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:48:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:48:22 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:48:22 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:48:22 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9320MB free_disk=24.9388427734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:48:22 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:48:23 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:48:23 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:48:23 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:48:23 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:48:23 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:48:23 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:48:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:48:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:48:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:48:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:49:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:49:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:49:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:49:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:49:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:49:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9314MB free_disk=24.93834686279297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:49:24 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:49:25 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:49:25 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:49:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:49:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:49:28 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:49:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:49:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:10 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:50:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:50:10 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:50:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:50:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:50:24 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:50:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9319MB free_disk=24.937843322753906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:50:24 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:50:25 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:50:25 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:50:25 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:50:25 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:50:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:50:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:30 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:50:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:50:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:50:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:50:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:50:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:51:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:51:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:51:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:22 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:51:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:51:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:51:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:51:26 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:51:26 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:51:26 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:51:26 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9318MB free_disk=24.937355041503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:51:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:51:26 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:51:27 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:51:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:51:31 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:51:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:51:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:52:09 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:52:09 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:52:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:52:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:52:12 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:12 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:52:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:52:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:52:28 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:52:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9312MB free_disk=24.93685531616211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:52:28 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:52:29 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:52:29 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:52:29 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:52:29 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:52:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:52:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:52:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:52:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:52:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:52:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:52:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:52:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:52:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:52:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:52:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:52:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:52:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:52:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:52:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:52:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:52:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:52:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:52:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:52:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:52:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:53:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:53:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:23 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:53:30 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:53:30 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:53:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9311MB free_disk=24.936355590820312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:53:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:53:31 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:53:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:53:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:53:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:53:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:53:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:53:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:53:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:53:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:53:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:53:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:53:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:53:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:53:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:53:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:53:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:53:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:54:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:54:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:54:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:54:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:54:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:54:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:54:30 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:54:30 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:54:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9313MB free_disk=24.935874938964844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:54:30 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:54:31 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:54:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:54:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:54:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:32 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:54:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:54:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:54:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:54:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:54:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:54:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:54:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:54:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:54:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:54:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:54:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:54:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:54:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:49 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:54:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:54:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:55:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:55:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:55:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:55:15 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:55:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:55:15 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:55:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:55:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:55:25 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:55:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:55:31 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:55:31 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:55:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9297MB free_disk=24.93535614013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:55:31 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:55:32 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:55:32 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:55:32 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:55:32 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:55:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:33 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:55:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:55:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:55:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:55:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:55:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:55:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:55:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:56:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:56:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:56:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:56:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:56:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:56:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:56:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:56:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:56:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:56:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:56:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:56:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:26 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:56:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:56:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:56:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:56:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:56:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:56:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:56:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:56:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:56:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:56:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:33 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:56:33 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:56:33 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9314MB free_disk=24.934871673583984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:56:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:56:33 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:56:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:56:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:56:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:56:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:50 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:56:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:56:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify base images {{(pid=74959) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc
Nov 29 00:57:03 user nova-compute[74959]: WARNING nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Unknown base file: /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Removable base files: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49 /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8 /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308 /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762 /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69 /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36 /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cc0b572a3934c6c91c5d5dcd6899800c14b5099d
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4a5224592be1001c0bd9d7655b4409e4df3c5f49
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/61bcca3c9d5b447059bb73dbf5df042035919cd8
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ebd0148316df90f2325aa0481867ae93a5489308
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/caaacbf2ea7a61b2049aff12245d3d606fa66c3e
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/030fdf7da2662befb9f447b4544df04186765762
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/982aecd7f62a882404d74f1d2f4a28742652ce69
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/68181c69da0682928052f35cfac153d13aebfe36
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9ec0ea7be0e4794c2a031fe103692894006c4ddc
Nov 29 00:57:03 user nova-compute[74959]: INFO nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/47c128d3aafd2b63ecffd82391d1a6bf0036fae7
Nov 29 00:57:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verification complete {{(pid=74959) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify swap images {{(pid=74959) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG nova.virt.libvirt.imagecache [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Verify ephemeral images {{(pid=74959) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 00:57:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:11 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 00:57:11 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 00:57:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:13 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 00:57:13 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:57:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:57:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:57:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:57:17 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:57:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:57:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:57:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:57:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:57:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:57:34 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:57:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9316MB free_disk=24.93435287475586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:57:34 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:57:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:57:35 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:57:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:57:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:57:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:57:36 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:57:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:57:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:57:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:58:04 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:16 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:58:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:58:16 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:58:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:28 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:29 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:58:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:58:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:58:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9324MB free_disk=24.933868408203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:58:35 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:58:36 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:58:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:58:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:58:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_power_states {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:38 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:43 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:48 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:58:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:58:53 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:58:58 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:03 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:08 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74959) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 00:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74959) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 00:59:13 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:18 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 00:59:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 00:59:18 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 00:59:18 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:59:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:23 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:28 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:30 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:33 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 00:59:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:59:35 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 00:59:35 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9321MB free_disk=24.93338394165039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 00:59:35 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 00:59:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 00:59:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 00:59:36 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 00:59:36 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 00:59:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 00:59:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 00:59:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 00:59:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 00:59:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:00:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:00:19 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:00:19 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:00:36 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:00:36 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:00:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9323MB free_disk=24.925071716308594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:00:36 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:00:37 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:00:37 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:00:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:00:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:00:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:38 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:00:38 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:53 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:00:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:00:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:01:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:01:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:01:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:01:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:01:31 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:35 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:01:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:01:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:01:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9319MB free_disk=24.92458724975586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:01:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing inventories for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating ProviderTree inventory for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Updating inventory in ProviderTree for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing aggregate associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, aggregates: None {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Refreshing trait associations for resource provider 54851fe4-2867-4d3c-b2f3-bede5755a160, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74959) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:01:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:01:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:01:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:01:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:01:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:14 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 01:02:14 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] There are 0 instances to clean {{(pid=74959) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 01:02:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:02:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:02:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:02:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:24 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:27 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:27 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Cleaning up deleted instances with incomplete migration  {{(pid=74959) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 01:02:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:32 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:02:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:02:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:02:37 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:02:37 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9306MB free_disk=24.92407989501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:02:37 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:02:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:02:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:02:38 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:02:38 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:02:38 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:02:38 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:02:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:40 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:40 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:02:41 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:02:55 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:02:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:03:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:03:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:03:21 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:24 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:29 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:33 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:34 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:03:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:34 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:37 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74959) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager.update_available_resource {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Auditing locally available compute resources for user (node: user) {{(pid=74959) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:03:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:03:39 user nova-compute[74959]: WARNING nova.virt.libvirt.driver [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:03:39 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Hypervisor/Node resource view: name=user free_ram=9313MB free_disk=24.923583984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74959) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:03:39 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:03:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:03:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74959) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:03:40 user nova-compute[74959]: DEBUG nova.compute.provider_tree [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed in ProviderTree for provider: 54851fe4-2867-4d3c-b2f3-bede5755a160 {{(pid=74959) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:03:40 user nova-compute[74959]: DEBUG nova.scheduler.client.report [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Inventory has not changed for provider 54851fe4-2867-4d3c-b2f3-bede5755a160 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74959) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:03:40 user nova-compute[74959]: DEBUG nova.compute.resource_tracker [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Compute_service record updated for user:user {{(pid=74959) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:03:40 user nova-compute[74959]: DEBUG oslo_concurrency.lockutils [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:03:44 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:44 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:03:49 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:54 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:03:59 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:04:04 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:04:09 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:04:14 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:04:19 user nova-compute[74959]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74959) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:04:20 user nova-compute[74959]: DEBUG oslo_service.periodic_task [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74959) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:04:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Starting heal instance info cache {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:04:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Rebuilding the list of instances to heal {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:04:20 user nova-compute[74959]: DEBUG nova.compute.manager [None req-b3621370-a0f7-48ee-adcd-3fd2a43cd5ff None None] Didn't find any instances for network info cache update. {{(pid=74959) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}